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ABSTRACT 



This thesis discusses and implements an interactive decision support system using 
a Prescriptive Garbage Can Model. The fundamental presumtion is that if the choice- 
outcome relationships in an organization can be observed and evaluated, it is possible 
to extract predictiveness from uncertain stream,s, and allow the organization to shift to 
a less random strategy. Solving organizational problems consists of selecting those 
choices that lead the organization in a direction towards the ideal state. Thus, it is 
convenient to model the organizational state transitions as a Markovian process with 
stationary properties. The purpose of a Prescriptive Garbage Can Model is to advise 
the participants of the choices available in a current situation, and to present choice 
policies leading the highest potential benefits. Also a method of interfacing the current 
system with an expert system for intelligent decision making is examined. 
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I. INTRODUCTION 



The Prescriptive Garbage Can Model (PGCM) of organizational decision-making 
[Refs. 1.2] can be defined as chance events resulting from the interactions of four 
elements in the organizational context, (i) problems, (ii) solutions, (iii) participants, and 
(iv) choice opportunities. As with every anarchic and random system, the participants 
desire to solve the current problem in the most effective manner. Which problems are 
actually taken up for action, in what priority, what choices are made in solving them, 
and how conclusively they are solved, are all functions of ambiguous preferences, and 
time and energy constraints of the participants. 

A model imparting some degree of structure and comprehensibility to the 
complex organizational interactions and suggesting rational choice policies in an 
otherwise irrational context may be of invaluable assistance to organizational decision- 
makers. Thus, the model is prescriptive in nature. The building of such a model would 
link rational decision-making [Refs. 1,3] with anarchic decision-making [Ref 2] 
thought. 

Three objectives of the model are the following : 

1. .Advise the participants of the choices available to them in a specific 
organizational state 

2. Estimate the expected benefit resulting from each choice 

3. Lay down choice policies which would assist the participants in leading the 
organization in the long run to the state that has the highest potential benefits 

Under severe lack of knowledge, decision makers may adopt a random search and 
choice rule, i.e., decisions are ill-defined, inconsistent, unclear, uncertain and 
problematic. Learning and outcomes are a matter of accidental trial-and-error. 

While random strategies are always available, one may wonder whether they can 
be imbued with conscious thought processes to deal with uncertainty more effectively. 
If the choice-outcome relationships in an organization can be observed and evaluated, 
it is conceivable to extract predictiveness from uncertain streams, and thereby allow the 
organization to shift to a less uncertain strategy, in particular toward cybernetic and 
stochastic decision procedures. 

This study discusses the design and implementation of the Prescriptive Garbage 
Can .Model to provide a best course of actions on the anarchic organizational system. 
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Chapter II provides background on the prescriptive organizational model of garbage 
can choice policies. This includes a stochastic approach to the garbage can model, 
definitions and assumptions about the components of PGCM, and a prescriptive model 
of organizational choice. Chapter III examines the decision making process and 
discusses the design and implementation using a militarx' offensive operation example. 
Chapter IV contains recommendations for further study on the topic. Appendix A is 
the source program. Appendix B is the user manual for the current implementation. 
Appendix C is a demonstration how offensive operation decision choices could be 
taken. Appendix D is a demonstration how university schedule decision choices could 
be taken. 
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II. BACKGROUND 



A. A STOCHASTIC APPROACH TO THE PRESCRIPTIVE GARBAGE CAN 

MODEL 

What appears on the surface as random organizational behavior is most likely 
not totally random, but casually influenced by a series of external factors and internal 
choices that can be modelled as probabilistic phenomena. It is often the difficulty of 
understanding numerous organizational and environmental forces that act 
simultaneously which renders probabilistic processes to appear as randont occurrences. 
Thus, it may be useful to assume that organizations are ultimately more probabilistic 
in nature than purely random. The probabilistic approach obviously implies an 
inevitable degree of indeterminancy. 

The prescriptive garbage can process, whereby problems, solutions, choices and 
participants are in organizational confluence, is made up of a large number of distinct 
actions sequenced over time. At any point in time, an organization can be 
characterized as belonging to a discrete organizational state. An organizational state is 
the conditional wherein essential characteristics of the organization (i.e., state 
variables) take on distinct and measurable values. During the fleeting existence of the 
organization in a specific state, if the participants were seeking globally optimal 
decisions, they would endeavor to identify the current state of the organization and 
exercise one of the choices that are available to them in that state. However, the effect 
of a decision may not be fully predictable. Thus, while a decision might be attractive 
in terms of an intended effect, an accurate decision calculus may not always be 
possible. Stated thus, organizational flux can be described as consisting of a stream of 
single-step state transitions over time due to the series of decisions made by the 
participants. In this perspective, stochastic modeling techniques may be applied to 
tame the transition phenomenon [Ref 1]. 

Despite the probabilistic nature of the organization processes, organizational 
structures are ultimately considered to be homeostatic. This homeostasis concept 
relates to the capacity of the organization to withstand random perturbations which 
have not been foreseen by the participants [Ref 1]. .According to cyberneticians, an 
organization may be in any of the enormous number of possible states with related 
choice opportunities. Solving organizational problems consists of selecting those 
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choices that lead the organization in a direction towards the ideal state. Thus, it is 
convenient to model the organizational state transitions as a Markovian process with 
stationary’ properties. A process is stationary when organizational states become stable 
and invariant under time shifts. The homeostatic nature of the organizations implies 
the operation of at least some stationary properties. 

B. DEFINITIONS AND ASSUMPTIONS 

1. Organizational Elements 

As defined in the PGCM. any organization consists of four relatively 
independent elements. They are (i) problems, (ii) solutions, (iii) participants, and (iv) 
choices. Relative independence implies that each element can assume its own identity, 
existence and relevance. In addition, we presume that problems are triggered by 
external or internal factors and represent the ntismatch between the current 
organizational state and the desired state. Solutions are either tools or answers directly 
available within the organization waiting to be bound to the appropriate problems. 
Participants with their limited stocks of energy focus their attention on important 
problems and search for attractive solutions. Choices act as a cementing factor that 
ties the above three elements together. 

2. Organizational States 

The organizational state Zj is a function of three attributes which describe an 
organization at a certain point in time. These attributes are : 

1. The importance of the problems remaining to be solved (P^), 

2. The effectiveness of the solutions applied to problems (S-) in the recent past, 

3. The energy levels of the participants available for problem-solving (E^). 

The choice of P, S and E as attributes of organizational states is motivated by 
the structure of the PGC.VI which employs these elements as building blocks. P, S and 
E are assumed to be independent and measurable attributes. For convenience of 
representation, we shall use the coordinate system to denote a state. Thus an 
organizational state, Z- = ( Pj . Sj , E- ). 

3. Choices 

Choices are decisions taken by participants in their pursuit to solve problems. 
They are deternuned by judging the nature of problems remaining to be solved, the 
effectiveness of the considered solutions, and the energy input available from the 
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participants required of a particular choice. In an organized anarchy, choices are 
assumed to be made accidentally. However, if choices were to be made rationally 
amidst the anarchy, they would presumably carr\’ the organization towards the state 
(0,1,1). Rational managers would prefer such a state because they would like to see as 
many of the remaining important problems solved as possible, in an elTective manner, 
and have at their disposal at all times a adequate supply of energy that can be applied 
to future problem solving. This is not to imply that managers wish to remain absorbed 
in state (0,1.1), since this means no opportunities, eternal calculations and unexpended 
energy. Rather, managers would prefer to attain a dynantic equilibrium at or close to 
(0,1,1). .At such equilibrium, there is a continuous flow of problem opportunities and 
their effective resolution in a timely fashion so that sufficient manpower energy is 
readily available to meet new problem opportunities as soon as they arise. 

In general, selecting a choice induces the transition of the organization to a 
new state in the next time interv'al. It is possible that taking no decisions is a choice in 
itself It can shift the current state to a new state with more problems. 

4. Choice Policies 

Choice policies provide a prescriptive approach to problem solving. Once a 
set of organizational states and associated choices available therein can be identified, it 
is possible to bring to bear rationality in decision-making by laying down choice 
policies. Choice policies consist of suggestions as to what choices should be preffered 
while the organization is perceived to be in a particular state, In a sense, choice 
policies form a set of guidelines for organizational decision makers. Usually, the choice 
policies are so recommended as will most likely bring in the maximum benefits for the 
organization in the long run. 

C. A PRESCRIPTIVE MODEL OF ORGANIZATIONAL CHOICE 
1. Organizational FUlx as Stochastic Transitions 

Introducing rationality into an anarchic system requires that the decision- 
makers observe a calculus of outcomes based upon the (i) understanding of the 
implications of the various organizational states, (ii) knowledge of all the choices 
available to them in each state, and (iii) assessment of the probable impact of 
e.xercising a choice on the current state, before they reach a decision. We infuse 
rationality into the Prescriptive Garbage Can .Model of anarchic actions through the 
use of a transition probability matrix. 
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The transition probability matrix represents the various organizational states, 
the available choices under each state, and the probabilities with which a choice can 
take the organization from one state to another. Z- , i = I n. denotes the 

organizational states; Cj (k), k = 1 , the choices available in a state i; qjj 

c(k), the probability that the initial state Z- will transit to Zj when some choice Cj (k) 
is taken. Implicit in the matrix is the fact that there is no guarantee a choice can 
always lead to a state that is predictable beforehand. Impossible states may be fdtered 
out from the matrix altogether and infeasible transitions may be represented by zeros. 
Note that Sj*^ij S ~ simplicity of notation, we omit the subscript i in Cj (k), 

and denote by c{k). 

The prescriptive model requires the determination of the transition 
probabilities. While several methods have appeared in the literature in estimating 
subjective probabilities, one that has evoked considerable interest in recent years 
consists of systematic elicitation of expert judgement [Refs. 1,4,5]. Expert knowledge 
and opinions often form an adequate surrogate, when historical data seem either 
inapplicable or unavailable. 

The following steps describe the mechanics of generating the transition 
probability matrix : 

• Step 1 : Determination of the set of organizational states, n. 

First, determine the number of possible values p can take. For this divide the 
scale (0,1) into as many scale points as possible, say r. Assuming these scale points are 
uniformly distributed, the value of each scale point p'^ can be generated using the 
formula, 

p^^ = (u-1) / (r-1), where u = 1 ..., r. 

For example, if r=3, then p^ = 0, p^ = 0.5, p^ = 1. The same formula can be 
applied to determine the scale points for S and E. The value of r need not have the 
same value for P, S, and E. 

Second, generate all possible combinations of , E'^ to determine all 

organizational states. If r = 2 for P, S and E, then the different organizational states 
can be described by one of the combinations. (P^ S^, E*), (P^ S^, E^). (P*. S", E^), 
(P^ S^, E-), (P-, S^ E^, (PN s', E-), (Pn SN e'), and (P^, S% e"). In general, 
assuming the partitions are equal for P, S and E (rp = r^ = r^) the maximum num.ber 
of possible organizational states that can be represented using the (P,S,E) coordinate 
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fornn is thus r'’. If r=2, these states can be denoted by Zj = (Pj, $•, Ej) where i = 1 

S. Thus. Zj=(P^ s\ E*), Z 2 = (P*. s\ E^) = S^, E^). 

Note that once each possible combination (P'^, S'^. E'’^) is assigned to a specific state 

Z;, i= 1 n. the actual values of P. S, E's in anv state thereafter be refered to bv P;, S; 

and Ej. The following Table 1 represents each organizational states. 



! state Z 2 

I ^ 


TABLE 1 

AN EXAMPLE ORGANIZATIONAL STATE 
(Pi , Si , Ei) Remarks 


1 


( 0. 0,0. 0,0. 0) 


2 


( 0. 0,0. 0, 1. 0) 


3 


( 0. 0,1. 0, 0. 0) 


4 


( 0. 0, 1. 0, 1. 0) 


5 


( 1. 0,0. 0,0. 0) 


6 


( 1. 0, 0. 0, 1. 0) 


7 


( 1. 0,1. 0,0. 0) 


8 


( 1. 0,1. 0,1. 0) 



• Step 2 : For each of the states Z| , identify and filter all the conceivable and 
feasible choices. 

Collect all these choices to form a set defined by D' = c{k), where k = 1, 

.... m^. In complex organizations, exhaustive enumeration of choices may be a difficult 
task. However, it is not unrealistic for organizations to anticipate and equip 
themselves with as many available choices as they can to meet different possible 
situations. 

• Step 3 ; For an initial state Zj . pick one of available choices 

As a result of c(k), assume the organization enters state Z;. 

• Step 4 : Estimate the probabilities P. S, E 

Ppj , pj c(k), where j = 1 n and Tj Ppj , pj c(k) = 1. Repeat for elements 

S and E. This gives 5p| , pj c(k) . and Ppj , pj c(k). 
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•. Step 5 : Compute the row of the transition probability matrix using the 
following formula 

Qij c(k) = Ppi , pj c(k) 5pi . pj c{k) Ppj . pj c(k) (eqn 2.1) 

herein, we notated P , S , E as estimation probabilities of P, S, E 

• Step 6 : Repeat for all remaining (m^ - 1) choices in Zj. 

• Step 7 : Repeat steps 3-6 for the remaining (n - i) states. 

The general layout of the transition probability matrix is shown Figure 2.1. 



Next 



State 



■ 21, C(l) 
Zl, C(2) 


ni[ir 


ql2C( 1) 
ql2C( 2) 


qi3C( 1) — 
ql3cU) •• 


qlnC( 1) 

qlnC( 2) 


Zl‘, ■ C( ml) 


qllC(ml) 


ql2C( ml ) 


ql3C( ml ) . . 


qlnC( ml ) 


Z2, C(l) 
Z2, C(2) 


q21C( 1) 
q21C( 2) 


q22C( 1) 
q22C( 2) 


q23C(l) ... q2nC(l) 

q23C{2) ... q2nC(2) 


Z2 ■ C( m2 ) 


q21C(m2) 


q22C(m2) 


q23C(m2) ! ! 


q2nC( m2 ) 


Z3, C(l) 
Z3, C(2) 


a31C( 1) 

q31cU) 


q32C( 1) 
q32C( 2) 


q33C(l) ... q3nC(l) 

q33cU) ••• q3nCU) 


Z3’ ■ C(m3) 


q31C( m3 ) 


q32C( m3 ) 


q33C( m3 ) . . 


q3nC( m3 ) 



C 

u 

r 

r 

e 

n 

t 

S 

t 

a 

t 

e 



Zn, C( mi ) qnlC(mi) qn2C(mi) qn3C( mi ) ... qnnC( mi ) 
Number of states = Z(l, ... , n) ; 

Number of choices in each state = C( 1, ... , m,- ) ; 
Transition probability matrix satisfies the condition 

Tj q^^j C(k) = 1, for k = 1, ... , mj_ 



Figure 2.1 An Example Transition Probability Matrix. 
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2. Goodness Measure of an Organizational State 

For each organizational state , we assume there is an associated measure of 
goodness, gj. This measure is ordinal in nature and reflects the amount of benefit 
derivable from the values of P, S and E corresponding to each state. The idea is 
similar to a balance sheet which conveys the state of health of an organization. S and 
E can be viewed as assets in a balance sheet, since they represent the strength of the 
organization. On the other hand, P can be viewed as a liability in that it detracts from 
the organizational performance. Note that high values of Sj and E- imply high values 
of g-. Conversely, high values of P- imply low values of g-. The composite amount of 
goodness for the state Zj can be e.xpressed as follows : 



In theor>’, the ideal state of the organization corresponds to g = 2. since P = 
0. S = 1, and E = 1. Contrarily, for the anti-ideal state, g = -1, since P = 1, S = 0 
and E = 0. The following Table 2 shows each goodness measurement. 




(eqn 2.2) 



T.ABLE 2 

,^N EXAMPLE GOODNESS MEASUREMENT 



State 




Goodness Remarks 



1 

2 

3 

4 

5 

6 

7 

8 



( 0. 0,0. 0,0. 0) 

( 0. 0,0. 0, 1. 0) 

( 0 . 0 , 1 . 0 , 0 . 0 ) 

( 0 . 0 , 1 . 0 , 1 . 0 ) 

( 1. 0,0. 0,0. 0) 

( 1. 0,0. 0, 1. 0) 

{ 1 . 0 , 1 . 0 , 0 . 0 ) 

( 1 . 0 , 1 . 0 , 1 . 0 ) 



0 . 0 
1 . 0 
1 . 0 
2 . 0 
- 1 . 0 
0 . 0 
0 . 0 
1 . 0 
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3. Transition Benefit 

The goodness measure of an organizational state can be related to the 
transition probabilities through the idea of transition benefit. Transition benefit is the 
e.xpected incremental goodness due to a transition that results from a specific choice. 
It is calculated as follows. 

• Step I ; Difference of goodness value between current state Zj and terminal 
state Zj for choice c(k) 

(gj - gj)c(k) = - (PjC(k) - Pi) + (SjC(k) - Sj) + (EjC(k) - Ej) (eqn 2.3) 



• Step 2 : Expected incremental benefit (G) of the choice 



G (Zj , c(k)) = Tj (gj - g;)c(k) * QijC(k) (eqn 2.4) 

If there are n states and Vj m| choices, the transition benefit matrix will be 
dimension of n x 

4. Identification of a Choice Policy 

We have seen that policy is a prescriptive function. Its purpose is to suggest 
which choice c(k) out of the possible set of choices c(l,2, ... nij) must be acted upon, 
given the organization is in state Z) If rationality in decision making is assumed, 
choices will have to be so exercised as to maximize gj. This can be achieved by 
maximizing the sum of the expected selection and sequencing of the different choices. 
Howard's algorithm can be employed to perform the maximization [Refs. 6,7]. The 
algorithm is applicable while dealing with a stochastic process where the law of 
transition and the corresponding benefit function are known. It consists of an 
intelligent trial and error iterative procedure that selects the best beneficial choice for 
each state in each iteration until the long run expected mean income per choice is 
maximized. The following one is the dynamic programming formulation. 



V(S) = max{i(S,a) - g + Y v(s)q^ , s C(a)}, for s = 1, .. , S (eqn 2.5) 
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Note S ; initial state, s ; next state, g : maximum mean income per period, a ; chosen 
action, s C(a) ; transition probability that transit from initial state S to next state s 
when action a is chosen. 

5. Reinforcement of Choice Policies through Learning/ Revision 

From a cybernetic perspective, generating a choice policy is a learning process. 
The organization should continually examine the outcomes following from the choices 
it made in the previous periods, reinforce the assessments of the organizational 
elements P, S and E. and revise its battery of choices. This results in the re-evaluation 
of the transition probability matrix and consequently leads to a new set of choice 
policies for the next period. 
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III. SOFTWARE DESIGN AND IMPLEMENTATION 



A. DECISION MAKING PROCESS 

The Prescriptive Garbage Can Model refers to a class of systems which support 
the process of making decisions. The decision maker can retrieve data and test 
alternative solutions during the process of problem solving. This system also should 
provide ease of access to the data base containing relevant data and interactive testing 
of solutions. The system analyst must understand the process of decision making for 
each situation in order to analysis a system to support it. The model proposed by 
Herbert A. Simon consists of three major phases [Ref 9], they are (i) intelligence 
phase, (ii) design phase, and (iii) choice phase. 

1. Intelligence Phase 

Searching the environment state calling for decisions. Estimation data are 
obtained, and examined for clues that may identify problems; set all estimation 
probabilities. One of the important fact is how to formulate the problems. A problem 
formulation might have a risk of solving the wTong problem, but the purpose of 
problem formulation is to clarify the problem so that design and choice activities 
operate on the right problem [Ref 9]. Frequently, the process of clearly starting the 
problem is sufficient; in other cases, some reduction of complexity is needed. Four 
strategies for reducing complexity and formulating a manageable problem arc [Ref 9] 

•. Determining the boundaries 

*. Examining changes that may have precipitated the problem 
». Factoring the problem into smaller subproblems 
•. Focusing on the controllable elements 

.A Prescriptive Garbage Can Model can obtain intelligence through searching, 
hence allow the user to approach the task heuristically through trial and error rather 
than by preestablished, fixed logical steps. So establishing analogy or relationship to 
some previously solved problem or class of problems is useful. 

2. Design Pha.se 

Inventing, developing, and analyzing possible courses of choices is performed 
in this phase. It involves processes to understand the problem, to generate solutions 
and to test solutions for feasibility. "A significant part of decision making is the 
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generation of alternatives to be considered in the choice phase" [Ref. 10]. The act of 
generating alternative is creativity that may be enhanced by alternative generation 
procedures and support mechanisms. In this process, an adequate knowledge of the 
problem area and its domain knowledge, and motivation to solve the problem will be 
required. Given these situations, analogies, brainstorming, checklists can enhance 
these creativities [Ref 9]. 

3. Choice Phase 

Selecting an choice from those available by using decision making 
software(.i.e., PGCM), can establish all choices for each organizational state. 

B. DESIG.NING THE PGCM HIERARCHY AND DFD 

1. Hierarchical Program Structure 

To process the PGC.VI, we first set up estimation probabilities and alternative 
actions through intelligence, design phase. Then we also establish choice policies 
through choice phase. Herein we focus on the choice phase that consists of two 
procedures. One is to produce all matrices such as organizational states, transition 
matri.x, goodness measure table, benefit matrix from given user 
requirements, specification. The other one is to apply these matrices to generate long 
run policy. Figure 3.1 shows the modules that are invoked by the main PGC.VI 
program. As we see, each of modules is a black box that takes input data, performs 
some transformation on that data, and process output data. 

2. Data Flow Diagram 

Since we are establishing modules as functional elements, we need to know 
what are the inputs, outputs. So for each module we will use a simple black box 
diagram to show the data flow of PGCM. For example, in Figure 3.2, there is a 
module labeled benefit matrix. Independent of all other modules in the program, we 
need transition matrix and goodness measure table. The followings are the 
inputs outputs parameters for each module [Ref 1 Ij. 

Module Getinfo (level 1.1) 

inputs : number of scale points for each factor (rp , r^ , r^) 
number of difierent choices for each state 
estimation probabilities 
process: store input data via user interaction 
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output ; estimation probability table 




Figure 3.1 Hierarchical Program Structure for PGCM. 



** Module Getstate (level 1.2) 

input : number of scale points for each factor (rp , r^ , r^) 
process: combinate all scale points 

output : organizational state table (size : n = ’’p '' * r^) 

** Module Gettransition (level 1.3) 



inputs : estimation probabilities 

organizational state table 
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process: calculate transition probability using formula 2.1 
output : transition probability matrices (size : n * nij * n)) 




Figure 3.2 Data Flow Diagram for PGC.Vl. 



Module Getgoodness (level 1.4) ** 
input ; organizational state table 
process: calculate goodness measure using formula 2.2 
output : goodness measure table (size : n) 



** Module Getbenefit (level 1.5) ** 
inputs : transition probability matrices 
goodness measure table 

process: calculate transition benefit probability using formula 2.3, 2.4 
output : transition benefit matrix (size ; n * maxchoice) 

** Module Initialize (level 2.1) ** 
input : transition benefit matrix 

process: select best choices for each state from transition benefit matrix that 
has the highest value in that state 

output : policy table (size : n) 

Module Dynamicformulation (level 2.2) ** 
inputs : transition benefit matrix 

transition probability matrices 
temporary’ policy table 

process: fill the coefficient table need to solve equations described by formula 2.5 
output : coefficient table (size : n * n + 1) 

** Module Resolvevariable (level 2.3) ** 
input : coefficient table 

process: resolve variable using gaussian eliinination method 
output : variable values 

Module Setnewaction (level 2.4) 
inputs : variable values 

transition benefit matrix 
transition probability matrices 
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process; set a new policy using howard algorithm 
output : new policy table 

C. PGCM PROCESS ALGORITHM 

1. Input Data via Terminal 

The current PGCM system needs to know number of scale points for each 
factor. dilTerent number of choices, and the estimation probability. 

2. Generate Transition/Benefit Probability(formuIa 2. 1,3,4) 

3. \’alue Determination Operation 

a) establish n linear simultaneous equations (vj , g). 

: use qjj and i(S,a) for a given policy to solve 

g + vj = i(S,a) + X Qij i = Ir 2, .... n 

b) set arbitaiy Vj equal to 0. normally v^ 

c) resolve and produce the relative values using gaussian method. 

4. Policy Improvement 

a) find the alternative C(k) that ma.ximizes the test quantity (vj , g). 

; Hnd max(i(S,a) C(k) + T qjj C(k) Vjj using the relative values 

vj of the previous policy, then C(K) becomes the new decision in the 
ith state, i(S.a) C(K) becomes i(S.a). and q-j C(K) becomes qjj 

b) perform this procedure for every state, and determine a new policy. 

5. Combined Operation in An Iteration Cycle 

a) select an initial policy from immediate benefit values. 

b) solve the relative values vj and g by setting v^^ to 0. 

c) find an alternative that has maximal benefit values. 

d) if all alternatives are equally same benefit values, leave it unchanged 

1) sort benefit values (1 .. choice(.n.)) 

2) calculate absolute dilference for each benefit values 

3) if a difference is less than 0.0001, take an old action else set 

a new action 
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e) repeat until the policies on two successive iterations are identical 

f) if gain value g is decreased, then set arbitary V|_j equal to 0, 
and repeat step3 thru step 5 until satisfied 

The above algorithms step 3 thru step 5 based on the policy iteration method 
for multiple chain processes [Ref 6]. 

D. IMPLEMENTATION WITH OFFENSIVE OPERATION EXAMPLE 

Decision making in battle field involves unclear problems, chance event solutions, 
fluid energy derived from participants, and choices that seldom resolve problems. At 
any moment in time, a battle field may have a large number of problems to deal 
with, different possible solutions to cope with these problems, and many participants to 
make the necessary choices. Since taking into account all of the problems 
simultaneously could confuse the illustration, we shall assume that there is only one 
problem to be addressed during the interval of time considered and that the problem is 
related to offensive operation. We assume the representative elements in the offensive 
operation are number of attack forces, weapon systems, weather, relation to the 
consequent military’ operation. Figure 3.3 shows a system flow chart of the 
Prescriptive Garbage Can Model process. 




Figure 3.3 System Flow Chart of PGCM. 
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1. User Interaction 

a. Define the problem and determine the organizational states 

Once we define the problem and number of scale points for each factor, we 
can combinate the organizational states. We shall limit the number of scale points to 
P = 3 (0. 0.5, 1.0), S = 3 (0, 0.5, 1.0), E = 2 (0, 1.0). Thus, if w'e take into account 
all the combinations of (Pj , S- , E|), we can have at most 18(3x3.x2) possible 
organizational states. Table 3 shows the description and the organizational states of 
this problem. 

b. Identify and filter all the conceivable and feasible choices 

In this example, we choose only 4 choices towards solving the offensive 
operation problem. They are 

C(l) : Smoke operation and do attack 

C(2) : Supporting high performance weapon systems 

C(3) ; Reinforcing attack forces 

C(4) : Changing attack forces 

For instance, (0.5, 0.5, 1.0) is one of these combinations denoted in our 
Table 3 by Zjq. It can correspond to a situation where an offensive forces have a 
good chance to attain their objectives successfully since they have no significant 
problems. But the military expert may have some questions such as the enemy's 
recovery ability from the previous shock or friendly forces's risks caused by a little 
shortage of attack forces, etc. So the militarc' expert may look for another action to 
protect friendly forces such as a smoke operation. A smoke operation can significantly 
reduce the enemy's effectiveness in both the day time and at night. Combined with 
suppressive fire, smoke will provide increased opportunities for maneuver forces to 
deploy while minimizing losses. Also the effective delivery of smoke at the critical time 
and place on the battle field will contribute significantly to the combined arms team 
winning the first battle. Therefore, we we choose a smoke operation as one of feasible 
choices. The rest of the choices are also chosen in a same manner. Generally each 
state may have a different set of feasible choices for each state. For example, we can 
pick out C(4) since Z(^ is an ideal state we don't have to retain on C(4) which can be 
selected in the worst situation, so Z^ has 3 choices. Hereby, we bring an interface 
problem between PGC.VI and expert system that identify and filter all the conceivable 
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TABLE 3 

DESCRIPTION OF PROBLEMS AND ORGANIZATIONAL STATES 



P : Importance of oroblems to be solved 

S : Deqree of effectiveness in problem-solving 
S ; Potential energy of participants 

pl=0 No significant problem regarding attack forces, 
mission load, weather, relation with consequent 
military operation 

p2=. 5 Moderate shortage of attacking forces, not good' 
weapon system good weather, a certain time delay 
to the consequent operation i 

p3=l Acute shortage of attacking forces, big mission! 

load, bad weather < a tremendous time delay to the | 
consequent operation | 

S1=0 Most of personnel have no experience in the battle] 
field, poor coordination with adjacent unit, 
poor performance weapon systems 
S2=. 5 Some personnel have an experience in the battle 
field, appropriate coordination and reasonable 
attack-defense forces ratio, good performance 
weapon systems, good logistic support systems 
S3=l Some personnel have an experience in the battle 
field, excellent coordination, best attack-defense 
forces ratio, excellent oerformance weapon systems 
, sufficient logistic support systems 

E1=0 Not quite proud of their operations , passive action 
E2=l High morale, high responsibility 



State , Sj_ , Ej_ ) Remarks 



JL 


( 0. 0,0. 0, 0. 0) 


2 


( 0. 0,0. 0, 1. 0) 


3 


( 0. 0,0. 5,0. 0) 


A 


0. 0,0. 5, 1. 0 


5 


0. 0, 1. 0,0. 0 


6 


( 0. 0, 1. 0,1. 0 


7 


0. 5,0. 0,0. 0 


8 


0. 5,0. 0, 1. 0) 


9 


(0.5,0. 5,0.0) 


10 


( 0. 5,0. 5, 1. 0 


11 


( 0. 5, 1. 0,0. 0) 


12 


( 0. 5, 1. 0, 1. 0) 


13 


1. 0,0. 0,0. 0) 


14 


1. 0,0. 0, 1. 0 


15 


( 1. 0, 0. 5, 0. 0 ) 


16 


1. 0,0. 5,1. 0) 


17 


( 1. 0,1. 0,0. 0) 


18 


1.0, 1.0, 1.0) 



ideal 



anti-ideal 



and feasible choices, if our problem has hundreds of organizational states. That system 
certainly helps all e.xperts. For the simplicity, this e.xample has all the same number of 
choices for each state, and Appendix D shows a different number of choices for each 
state. 
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c. Estimate the probabilities using expert judgement 

Using expert judgement, estimate the probabilities P^- , c(k), where j = 

1,2. , 18 and Tj Ppj , pj c(k.) = 1. Repeat for elements S and E. This gives Sp- . pj 

c(k) . and Ppj , pj c(k). Given Pj = 0 and C(l), Pj may transit to a new state Pj , 
where Pj can be 0. 0.5 or I.O. By examining historical data and gathering advice from 
senior officers or military experts, assess the degree of influence of changing attacking 
forces on Pj and translate the assessment into matching probabilities, Pq , q C(l), Pq , 
Q.^ C(l), Pq , J C(l), with which each of these three transitions can take place. In our 
Case, These probabilities are shown below. 

^pi-pjC(l) 



1 

1 Initial State Pj = 0 Choice C(l) 


II 

o 


Terminal State 
Pj = 0.5 


Pj = 1.0 


0.98 


0.01 


0.01 



The values shown in the table implies that if there are no major problems 
regarding offensive operation at the present time (since Pj = 0), then the chances are 
low that new problems might occur merely on account of changing attacking forces. 

We now consider Sj , the effectiveness of solutions. Let Sj = 0 be the 
initial state of S^. Focus on the same choice C(l). As before, we estimate the values of 
Sq . Q C(l), Sq , Q.^ C(l), Sq , j.Q C(l). Their values in our case are shown below' 

-pi ' pj 



Initial State Sj = 0 Choice C(l) 

j 


Terminal State 

Sj = 0 Sj = 0.5 

1 J J 


Sj = 1.0 


0.97 0.02 


0.01 
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We also consider Ej , the potential energy of participants that has only 2 
scale points. Let Ej = 0 be the initial state of Ej. consider on the same choice C(l). 
Their values in our case are shown below 



Spi'pjCd) 



Initial State Sj = 0 Choice C(l) 



i 



Terminal State 


Ej = 0 


Ej = 1.0 


0.95 


0.05 



2. Transition Probability Matrix 

Use formula 2.1 to compute the row of the transition probability matrix, qjj 
C(l), corresponding to state Zj and choice C(l). In this step, we consider all the three 
elements discussed above together to generate the joint transition probabilities, for the 
initial state Zj (0,0,0) of the battle field, due to changing attacking forces. Repeat to 
generate an transition matrix for the remaining 17 states. Table 4 shows the transition 
probability matrix of Zj. The upper part of this table is an application of formula 2.1 
in connection with changing attack forces and the lower part is for the remaining 
choices. C(2), C(3), and C(4). The remaining transition probability matrix. Z 2 , ... . Zjs 
will be shown in .Appendix C. 

3. Goodness Measure 

The goodness measure for each state is computed using formula (2.2). The 
resulting g values for our example are given in Table 5. As shown in Table 5, state Z^ 
represents the ideal state in that it yields the highest possible benefit, i.e., g=2. 
Conversely, the anti-ideal state, Zj^ is the most adverse state for the organization 
since the corresponding benefit is the lowest. 

4. Transition Benefit Matrix 

Based on the transition probability matrix and the vector of goodness 
measure, compute the transition benefits using formulas 2.3 and 2.4.. The result of 
performing this procedure for all the initial states is shown in Table 6. 
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TABLE 4 

TR.ANS1TI0N PROBABILITIES IN Zj 



Computation of Transition Probabilities C(l) 

Initial State: 2 ^=^ q q qj. Choice C( 1 ): Changing forces 

Terminal State Formula Transition prob. 

P S E 



0. 


0, 


0. 


0, 


0. 


0] 


I . 0, 


. 0*. 


0, 


. 0*. 


0 


0. 


0, 


0. 


0, 


1. 


0 


I .0, 


. 0*. 


0, 


. 0*. 


0 


0. 


0, 


0. 


5, 


0. 


0 


1 . 0, 


. 0* . 


0, 


. 5*. 


0 


0. 


0, 


0. 


5, 


1. 


0 


I .0, 


. 0*. 


0, 


. 5*. 


0 


0. 


0, 


1. 


0, 


0. 


0 


) . 0, 


. 0*. 


0, 


1. *. 


0 


0. 


0, 


1. 


0, 


X . 


0 


1 . 0, 


. 0*. 


0, 


1. *. 


0 


0. 


/ 


0. 


0, 


0. 


0 


1 . 0, 


. 5*. 


0, 


. 0*. 


0 


0. 


5 , 


0. 


0, 


1. 


0 


I .0, 


. 5*. 


0, 


. 0*. 


0 


0. 


5, 


0. 


5, 


0. 


0 


1 .0, 


. 5*. 


0, 


. 5*. 


0 


0. 


5 / 


0. 


5, 


1. 


0 


I .0, 


. 5*. 


0, 


. 5*. 


0 


0. 


5, 


1. 


0, 


0. 


0 


1 . 0, 


. 5*. 


0, 


1. *. 


0 


0. 


5, 


1. 


0, 


1. 


0 


1 . 0, 


. 5*. 


0, 


1. *. 


0 


1 


0, 


0. 


0, 


0. 


0 


I .0, 


1. *. 


0, 


. 0*. 


0 


i; 


0, 


0. 


0, 


1. 


0 


1 . 0, 


1. *. 


0, 


. 0*. 


0 


1. 


0. 


0. 


5, 


0. 


0 


1 . 0, 


1. *. 


0, 


. 5*. 


0 


1. 


0, 


0. 


5, 


1. 


0 


1 .0, 


1. *. 


0, 


. 5*. 


0 


1. 


0, 


1. 


0, 


0. 


0 


1 . 0, 


1. *. 


0, 


1. *. 


0 


1. 


0, 


1. 


0, 


1. 


0 


1 .0, 


1. *. 


0, 


1. *. 


0 



. 0 0.98*0.97*0.95=0.903070 

1. 0.98*0.97*0.05=0.047530 

. 0 0.98*0.02*0.95=0.018620 

1. 0.98*0.02*0.05=0.000980 

. 0 0.98*0.01*0.95=0.009310 

1. 0.98*0.01*0.05=0.000490 

. 0 0.01*0.97*0.95=0.009215 

1. 0.01*0.97*0.05=0.000485 

. 0 0.01*0.02*0.95=0.000190 

1. 0.01*0.02*0.05=0.000010 

. 0 0.01*0.01*0.95=0.000095 

1. 0.01*0.01*0.05=0.000005 

. 0 0.01*0.97*0.95=0.009215 

1. 0.01*0.97*0.05=0.000485 

. 0 0.01*0.02*0.95=0.000190 

1. 0.01*0.02*0.05=0.000010 

. 0 0.01*0.01*0.95=0.000095 

1. 0.01*0.01*0.05=0.000005 



Transition Probabilities q^j c(k) 



state 

state 


^1 “^l j ^ ) 

C( 1) 


for j = 1, . 
C(2) 


. . . , 18; k = 

C(3) 


1 4 

C(4) 


1 


0. 903070 


0. 039200 


0. 617400 


0. 018000 


2 


0. 047530 


0. 156800 


0. 264600 


0. 072000 


3 


0. 018620 


0. 137200 


0. 061740 


0. 036000 


4 


0. 000980 


0. 548800 


0. 026460 


0. 144000 


5 


0. 009310 


0. 019600 


0. 006860 


0. 006000 


6 


0. 000490 


0. 078400 


0. 002940 


0. 024000 


7 


0. 009215 


0. 000400 


0. 006300 


0. 036000 


8 


0. 000485 


0. 001600 


0. 002700 


0. 144000 


9 


0. 000190 


0. 001400 


0. 000630 


0. 072000 


10 


0. OCOOlO 


0. 005600 


0. 000270 


0. 288000 


11 


0. 000095 


0. 000200 


0. 000070 


0. 012000 


12 


0. 000005 


0. 000800 


0. 000030 


0. 048000 


13 


0. 009215 


0. 000400 


0. 006300 


0. 006000 


14 


0. 000485 


0. 001600 


0. 002700 


0. 024000 


15 


0. 000190 


0. 001400 


0. 000630 


0. 012000 


16 


0. 000010 


0. 005600 


0. 000270 


0. 048000 


17 


0. 000095 


0. 000200 


0. 000070 


0. 002000 


18 


0. 000005 


0. 000800 


0. 000030 


0. 008000 



30 



State 


TABLE 5 

EVALUATING GOODNESS MEASURES 

(Z^) (?i , Si , Ei) 




1 




0. 0 


0. 0 


0. 0 


0. 0 




2 




0. 0 


0. 0 


1. 0 


1. 0 




3 




0. 0 


0. 5 


0. 0 


0. 5 




4 




0. 0 


0. 5 


1. 0 


1. 5 




5 




0. 0 


1. 0 


0. 0 


1. 0 




6 




0. 0 


1. 0 


1. 0 


2. 0 


ideal 


7 




0. 5 


0. 0 


0. 0 


-0. 5 




8 




0. 5 


0. 0 


1. 0 


0. 5 




Q 




0. 5 


0. 5 


0. 0 


0. 0 




10 




0. 5 


0. 5 


1. 0 


1. 0 




11 




0. 5 


1. 0 


0. 0 


0. 5 




12 




0. 5 


1. 0 


1. 0 


1. 5 




13 




1. 0 


0. 0 


0. 0 


-1. 0 


anti-ideal 


14 




1. 0 


0. 0 


1. 0 


0. 0 




15 




1. 0 


0. 5 


0. 0 


-0. 5 




16 




1. 0 


0. 5 


1. 0 


0. 5 




17 




1. 0 


1. 0 


0. 0 


0. 0 




18 

i 

1 




1. 0 


1. 0 


1. 0 


1. 0 









TABLE 6 








TR^\NS1TI0N BENEFIT MATRIX OF ALL CHOICES 


State 


2i 


Choices 


C(k) 




Stare 


crn 


cm 


cm 


cm 


1 


0. 055000 


1. 235000 


0. 340000 


0. 800000 


2 


-0. 005000 


0. 425000 


-0. 010000 


-0. 300000 


3 


0. 175000 


1. 180000 


0. 580000 


0. 400000 


A. 


0. 115000 


0. 370000 


0. 230000 


-0. 700000 


5 


0. 020000 


0. 770000 


0. 270000 


-0. 100000 


6 


-0. 040000 


-0. 040000 


-0. 080000 


-1. 200000 


7 


0. 160000 


1. 595000 


0. 750000 


1. 200000 


8 


0. 100000 


0. 785000 


C. 400000 


0. 100000 


9 


0. 280000 


1. 540000 


0. 990000 


0. 800000 


1 10 


0. 220000 


0. 730000 


0. 640000 


-0. 300000 


11 


0. 125000 


1. 130000 


0. 680000 


0. 300000 


12 


0. 065000 


0. 320000 


0. 330000 


-0. 800000 


13 


0. 090000 


1. 600000 


1. 045000 


1. 700000 


14 


0. 030000 


0. 790000 


0. 695000 


0. 600000 


15 


0. 210000 


1. 545000 


1. 285000 


1. 300000 


16 


0. 150000 


0. 735000 


0. 935000 


0. 200000 


17 


0. 055000 


1. 135000 


0. 975000 


0. 800000 


18 


-0. 005000 


0. 325000 


0. 625000 


-0. 300000 
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5. Generate the long run choice policy 

The objective of this step is to determine the offensive operation policy by 
evaluating what choices result in highest benefits in the long run as the battle field 
stochastically transits from one state to another. The mathematics of ma.xiinization of 
the long run benefit, when the law of transition shown in Table 4 and benefit function 
shown in Table 6 are known, can be achieved using Howard's algorithm. Let's trace 
the long run choice policy by applying formula 2.4. 
a. Initialize policy table 

Select best choices for each state from the benefit matrix that has 
maximum value among C(l) thru C(5), and set up a policy table as the following table. 




b. Resolve variables and evaluate max property 

Once we have resolved all the variable values (v{l), ... , v(18), g) using 
gaussian elimination method [Ref. S] we check to see if these resolved values satisfy the 
maximal property expressed in formula 2.4. For each state-action pair S.a, we evaluate 
i(S.a) - g + y v(s)qg , s C(a) and then for each state S choose the maximizing act "a" 
[Ref 7j. This leads to 

State i(S,a) T v{s)qg , s C(a) 

(1,M 0.055-g + 0.903070v(l) + 0.047530v(2) .. = l.OOE + 00 - g 
( 1.2) 1.235-g + 0.039200v(l)-f-0.156S00v(2) .. =l.00E + 00-g* 

(1.3) 0.340-g + 0.617400v(l)-k0.264600v(2) .. =1.00E + 00-g 

(1.4) 0.S00-g + 0.01S000v(l) + 0.072000v(2) .. =1.00E + 00-g 



(10.1) 0.220-g + 0.000019v(2) + 0.00l8Slv(3) .. = -6.25E-16 - g=" 

(10.2) 0.730-g + 0.000070v(2) + 0.006930v(3) .. =-1.50E-15-g 



(10.3) 0.640-g + 0.000400v(2) + 0.007600v(3) .. =-1.62E-l5-g 

(10.4) -0.300-g + 0.006000v(2) + 0.014000v(3) .. =-8.60E-16 - g 



c. Set a new policy table 

At the above step, we observed a new policy, marked by the asterisks and 

they are 



New Choice Policy Table 


SI S2 S3 . , 


. . S7 S8 S9 SIO . . . S15 S16 S17 SIS 


i 

2 4 2.. 


.2221.. .2 3 2 1 



d. Compare a new policy table with a previous one 

Repeat b) and c) until a new policy table and a previous policy table 
correspond each other or the maximal income per unit time (g) is decreased. The latter 
case .occasionally happens, and is possible in the case of g value near zero. For this 
unstable state, we set recursively arbitar\' Vj_j equal to 0, and repeat a) thru c). 

e. Test result 

As a result of prescriptive garbage can model execution, we lay down a 
policy table shown in Table 7 that have solved expressed by formula 2.5. Given Table 
7 recommend and advise the commander of the best choices available in a specific 
organizational state. For example, if given situations are (i) Acute shortage of 
attacking forces, big mission load, a tremendous time delay to the consequent 
operation, (ii) Most of personnel have no experience in the battle field, poor 
coordination with adjacent, poor performance weapon systems, (iii) Not quite proud of 
their operations, we would like to change attack forces known as choice 4 to achieve 
his goal. Like this we can select choice 1 (do smoke operation) in state 6,10,18, choice 
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2 (supporting high performance weapon systems) in state 1,3,4,7,8,9.11,14,15,17. choice 
(reinforcing attack forces) in state 12,16. and choice 4(changing attack forces) in state 
.5,13. 



TABLE 7 

SELECTED CHOICE POLICIES 


State 


Choice Policy 


2h 


C(k) 


i 


2 


2 


4 


3 


2 


4 


2 


5 


4 


6 


1 


7 


2 


1 8 


2 


1 ^ 


2 


1 10 


1 


11 


2 


12 


3 


13 


4 


14 


2 


15 


2 


16 


3 


17 


2 


1 


1 
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IV. FURTHER RECOMMENDED STUDIES 



This thesis considers a prescriptive garbage can model to advise the participants 
of the choices available to them in a specific organizational state, and implements it to 
generate a choice policy table. The current system covers chance events resulting from 
the interactions of four elements in the organizational conte.xt, (i) problems, (ii) 
solutions, (iii) participants, and (iv) choice opportunities. The computer program could 
be modified to process a greater number of organizational states depend on a memory' 
allocation(current system maxchoice 5, maxstate 36). 

An ideal PGCM would be one that interfaces with an expert system to 
automatically transfer estimation probabilities and feasible actions about the 
organization problem into PGCM system without human intervention. The following 
diagram shows how an expen system would be used. 




Interface between Expert System and PGCM 

.'^n expert system uses methods of reasoning to eliminate bad courses of actions 
and to determine the best courses of actions to achieve a goal. Expert systems use 
information in an intelligent way to perform tasks that are normally associated with 
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human experts. There are many anarchic and random situations, but human experts 
have some difficulties to find the best choice ever}' time. Hereby we illustrated a 
diagram as one possible model to interface between PGCM system and expert system 
to determine the best actions for the given set of organizational states. The next step 
in this study is how to interface an expert system to estimate transition probabilities 
and feasible actions for input to the prescriptive garbage can model. 
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APPENDIX A 
A SOURCE PROGRAM 



PROGRAM PGCMPROG( Input, Output); 
(*$s 400000 *) 



^ TITLE 
** AUTHOR 
** Date Written 



Product 
System Used 

I/O Process 

Description 



PRESCRIPTIVE GARBAGE CAN MODEL ** 

Maj Kang, Sun Mo 
11 Feb - 19 May 87 



■k-k 
kk 
'k'k 
'k'k 
'k'k 
:k7< 

'k-k 
kk 
kk 

kkkkkkkkkkkkkkkkkkk 



kk 
kk 
kk 
kk 
kk 
kk 
kk 
kk 

This program is an interactive ** 
choice processing system to support ** 
decision making By using Prescriptive** 
Garbage Can Model ** 

kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk'^ 



Version 1. 

IBM 3033 VM/CMS 

Terminal Keyboard 



(** Global Constants 
const 



kk) 



type 



zero 


= 


0; 






one 


= 


1; 






two 


= 


2; 






three 


= 


3; 






four 


— 


4; 






six 


= 


6; 






eight 


= 


8; 






1 6n 


= 


10; 






seventy 




70; 






maxfactor 


— 


3; (* 


number 


of 


maxchoice 


= 


5; (* 


number 


of 


maxscales 


= 


5 ; (* 


number 


of 


maxstate 


= 


36; (* 


number 


of 


maxstateetc= 


=37; (* 


number 


of 


maxrov; 




180; (* 


number 


of 


counter 


= 


0. .maxint; 





maximum 



i 

choice for each state ^ 

scale point for one factor ^ 

c P h o c 



inputtype 

line 

length 

last 

end; 

commands 

usermsgs 



record 

array( .one .. seventy. ) of char; 

counter; 

counter; 



= (EXECGCM, 
= (BADLINE, 



EXECEXIT, BAD); 

NOINPUT, NOINTERACT, ETCVAL, 
NONNUM, OVERSTATE, IMPOSSIBLE); 
choicetable = arrayCone . .maxstate . ) of integer; 
transitiontable=array( .one. .maxrow, one. .maxstate 
benefittable = arrayi .one. .maxstate, one . .maxchoice 
policytable = array( .one . .maxstate . ) of integer; 



ETCCHO, 



:! 



of real; 
of real; 



(** Global Variables **) 
var 

possiblestates , 
int, vi : integer; 

gain : real; 

wait ; char; 

choices : choicetable; 
tranmatrix: transitiontable ; 
benematrix: benefittable; 



37 



policy 

userinp 

command 

helpf ile 

quitnow, 

goodvalue 



; policytable; 

: inputtype; 

: commands ; 

: text; 

: boolean; 



* m ### *j 

(* ### Functions tt## 

I* === Function Getinp === *) 

Function getinp(var userinp : inputtype) tboolean; 

(* Get a single-letter command, 

making sure it is in the set of valid commands *) 

var 

ch ; char; 
begin 

userinp . length ;= 0; 
userinp. last := 0; 
if eof then getinp := false 
else begin 

while not eoln do begin 
read(ch) ; 

if userinp . length < seventy then begin 

userinp . length := userinp . length + 1; 
userinp. line( .userinp. length. ) := ch; 

end 

end; 

readln; 

getinp := true; 

end; 

end; (*getinp '^) 



(k ========================================== k\ 

>2 ~~~ Function Skipblanks === *) 

Function skipblanks (var userinp : inputtype) :boolean; 
var 

blank : boolean; 
beain 

blank := true; 

v/hile (userinp. last < userinp. length) and blank do begin 
userinp. last := userinp. last + 1; 
if userinp. line( .userinp. last. ) <> ' ' then 
blank := false 

end; 

if not blank then 

userinp. last := userinp. last - 1; 
skipblanks := blank; 
end; (* skipblanks *) 



k ========================================== * 

* === Procedure Getchar === * 

k ========================================== * 



g rocedure getchar(var userinp ; inputtype ; var ch:char); 
egin 

if userinp. last < userinp. length then begin 
userinp. last := userinp. last t 1; 
ch := userinp. line( .userinp. last. ) ; 
end else 
ch := ‘ ' ; 
end; get char *) 



k ========================================== * 

* === Procedure Writeuser === * 



rocedure writeuser (msg:usermsgs) ; 
egin 

case msg of 
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BADLINE 

NOIMPUT 

NOINTERACT 

NOMNUM 

ETCVAL 



ETCCHO 



OVERSTATE 



IMPOSSIBLE 



writeln('Bad Input, try again 
v;riteln( ' Have no data, try again 
writeln( ‘Nothing typed, try again 
writeln( 'Nonnumeric data, try again 
begin 

write ( 
writeln( 
end; 



<press 

<press 

<press 

<press 



enter 

enter 

enter 

enter 



key> ' 
key> ' 
key> ' 
key> ' 



Available scale point 
'<press enter key>‘); 



2 to 9 , try again ‘ ) 



end; 

readln(wait) ; 
end; 



begin 

write ( 
writeln( 
end; 
begin 

write ( 
writeln( 
end; 
begin 

write ( 
writeln( 
end; 



Available choice : 
<press enter key> ' ) 



2 to 5, try again 



); 



Maximum organizational states is less M; 
than 36, try again <press enter key> ' ) ; 



Cannot set up, try again 
<press enter key>^ ) ; 



with new data ' ) ; 



f •k:k-kiz7Z7ziK-k:k:k-kii:'k:k'k:k:k-k:k:k:k'k-k-k7K:ki<:'k9<::k9<::k'k:k:kiz'k:k:k:k:k-k:k:k:k:k\ 

/aa'tcxA: Function Getcommand :kv^:k-k:k\ 

Function getcommand(var command:commands) :boolean; 
Get a single- letter command, 

make sure it is in the set of valid commands 

var 

ch : char; 

userinp : inputt^pe ; 
begin 



page; 
v;riteln 
writeln 
writeln 
writeln 
writeln 
writeln 
writeln 
writeln 
v;riteln 
writelni 
writelm, 



GCM Program Options are the followings 



1 I 

I •k'k'k 
I 

I :k:k:k 
I :k'k'k 
I :k-kiK 
I :k:k:k 
I 7K7^:k 
1 ‘k’k:k 
I ‘k'k:k 
I 



1, ExecGCM (Execute GCM Program 

2. ExecExit(Execution stop 

Typ?^ 



! f ! ! 



=====> Type. Number 

v/riteln( ' 
getcommand ;= false; 
command := BAD; 
if getinp(userinp) then begin 
qetcommand := ‘true; 

if not skipblanks(userinp) then begin 
getchar (userinp , ch) ; 
if skipblanks(userinp) then 
if ch in ( . ' 1 ' , ' 2 ' . ) then 
case ch of 

'1' : command := EKECGCM ; 
'2‘ : command := EXECEXIT; 
end 

else getcommand := false; 

end; 

end; 

end; 



kkk 1 


:67) 


k-kk 1 


:67) 


kkk 1 


:67) 


kkk 1 


:67) 


kkk 1 


:67) 


kkk 1 


:67) 


kkk 1 


:67) 


kkk 1 


:67) 


kkk 1 


;67) 


kkk 1 


:67 


kkk 1 


:67 


kkk 1 


:67) 
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* ### ### * 

* ### G C M PART II. ### * 

* ### Generate Matrix ### *) 

* ### , , ### *) 

* tt## generate transition probability, if## *) 

^ transition benefit probability, ### *) 

* ### organizational states, goodness ### *) 

(* measure table: Input for Part III ### 



7t*:^xx get transition, BENEFIT MATRIX *****) 



Procedure Getmatrix(var possiblestates:integer ; var choices rchoicetable: 
var tranmatrix: transitiontable; var benematrix :benef ittable ) ; 

const 

maxirow = 45; 

type 

scaletable = array ( . one . .maxfactor . ) of integer- 
scalevaltable = array ( . one , .maxscales , one . .maxscales , ) of real; 



var 



estimationtable=array ( .one. .maxfactor , one . .maxirow, one . .maxscales. ) 

of real; 

combination = record 

column : array ( .one . .maxfactor . ) of real; 
end; 

statematrix = array ( .one . .maxstate . ) of combination; 
goodnessmatrix = array ( . one . .maxstate . ) of real; 



numf actor , 

maxcho 

scales 

scalevals 

statmatrix 

goodmacrix 

estmatrix 



integer; 
scaletable ; 
scalevaltable ; 
statematrix; 
goodnessmatrix; 
estimationtable ; 



>-k ^ Get Number of Factors *** * 

' "k k’k’kk’k’k'kkkk’kkkkkk’kkkkkk’kkkkkk’kk’k’k'kkkk'k’k'k’k’kk k' 



Procedure getnumoffactor (var numfactor : integer ; 

var possiblestates : integer ; 
var scales:scaletable) ; 



var 

i : integer; 

ch : char; 

indomain : boolean; 



* === Function Get Max # of Staces === * 

k ========================================== X 



Function Getmaxnum(num : integer; scales : scaletable) -.integer ; 
var 

base, i : integer; 
begin 

base := one,- 

for i := 1 to num do 
base := base ” scales( . i. ) ; 
getm.axnum := base,- 
end; 



begin 

writeln( 'Number of factors 3 -- P, S, E ' ) ,- 

writeln( ' ' ) ; 

writeln; 
numfactor := 3; 

writeln( 'Enter # of scale points for each factor : 
writeln( ' 
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writeln; 



aet 

:= false 



number of scale point **************) 

1 ^) 



indomain 
repeat (^repeat 
i : = 1 ; 
repeat (^repeat 2*) 
goodvalue := false; 
v.’riteln( ' factor i :2 , ' : '); 
if getinp(userinp) then 
begin 

if not skipblanks (userinp) then 
begin 

getchar(userinp , ch) ; 
if skipblanks (userinp) then 

■ ^ *• i i-^i i/ti ir 



if cn in 
begin 
case 

' 2 ' 

.3, 

141 

'5' 
' 6 ' 
'7' 

' 8 ' 
.91 

end; 



I c I I A I 



8' , '9' .) then 



ch of 

int := 2; 
int := 3; 
int := 4; 
int := 5; 
int := 6; 
int := 7; 
int := 8; 
int := 9; 

(*caseend='') 
goodvalue := true; 
end (’^endif ch*) 

else writeuser (ETCVAL) (*else ch*) 
else writeuser (ETCVAL) (*else shipblanks*) 
end (*endif notskipblanks*) 

else writeuser (NOINPUT) (*else notskipblanks*) 
end (*endif getinp*) 

else writeuser (NOINTERACT) ; (*else getinp*) 

if goodvalue then 
begin 

scales(.i.) := int; 
i : = i + 1 ; 
end 

until (i = numfactor+one ) ; (*end repeat2 *) 

(x*x**x**** check and correct scale point ********!'*) 
repeat (*repeat3*) 

writeln('# of scale points are : '); 
for i := one to numfactor do 

writeln( ' factor i :2 , ' : ' ,scales( .i. ) ) ; 
writeln( ' goahead : Press any key, correction : 
writeln; writeln; 
readln(ch) ; 

if ch = then begin 

writeln( ' Enter factor number and value : '); 
readln(i, scales( .i. ) ) ; end; 
until not(ch = '%'); (*end repeats*) 

possiblestates ;= getmaxnum (numfactor, scales); 
indomain := (possiblestates <= 36); 
if not indomain then writeuser (OVERSTATE) ; 
until indomain; (*end repeat 1*) 
end; 



"%" ’ ) ; 



-k-k-k Qet Number of Choices 

/ kkkkkkkkkkkkkkkkkkkkkkk7<;kkkkkkkkkkkkkkkkkk k\ 

Procecdure getnumofcho ices (numfactor : integer ; possiblestates ; integer; 

var choices :choicetable ; var maxcho : integer ) 

var 

i : integer; 

ch ; char; 

begin 



42 



write ('Get Number of Choices for each State Z(i) ' ) ; 
writeln('i = 1 . . ' ,possiblestates :3) ; 

write (' . '); 

writeln( ' '): writeln.- 



^****:^****7: ggt number of choice ***********^**) 
1 : = 1 ; 
repeat 

goodvalue := false; 
writeln( ' State i :3 , ' : '); 

if getinp(userinp) then 
begin 

if not skipblanks(userinp) then 
begin 

getchar (userinp , ch) ; 
if skipblanks (userinp) then 
if ch in (. '2' , '3' , '4' , '5' .) 
begin 
case 
' 2 ' 

'3' 

'4' 

'5' 
end; 



then 



2 ; 

3; 

4; 

5; 



ch of 
int 
int 
int 
int 

(*caseend*) 
goodvalue ;= true; 
encf (*endif ch*) 

else writeuser (ETCCHO) (*else ch*) 
else writeuser (ETCCHO) (*else shipblanks*) 
end (*endif notskipblanks*) 

else writeuser(MOINPUT) (*else notskipblanks*) 



end (*endif getinp*) 
else writeuser (NOINTERACT) 



(*else getinp*) 



if goodvalue then 
begin 

choices(.i.) ;= int; 
i : = i + 1 ; 
end 

until (i = possiblestates+one) ; (*end repeat2 *) 

^ :k ":k :k :k ch6Ck 3Pci C0rr6Ct 

writeln( ' state Z(i) # of choices'); 

writeln(' '); 

repeat 

for i := one to possiblestates do 
writeln(i:6, choices( .i. ) :20) ; 
v;riteln( ' goahead : Press any key, correction : "%"'); 
v;riteln; writeln; 
readln(ch) ; 

if ch = then begin 

writeln( ' Enter state number and value ; '); 
readln(i, choices (. i .)) ; end; 
until not(ch = ' %' ) ; 
maxcho := -999; 

for i := one to possiblestates do 

if choices (.i.) > maxcho then maxcho := choices ( .i. ) ; 

end; 



}-k -k-k-k Qgt Estimate Probability *** *) 

Procedure getestprob(numfactor: integer; maxcho.-integer; 

scales :scaletable ; var scalevals .-scalevaltable,- 
var estmatrix:estimationtable) ; 

var 

i,j,k,l,m,n ; integer; 
p : real; 

ch : char; 



A — —==—:z:r— A \ 

* === Get scale points of each factor === *; 
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Procedure Getvalofscale(num:integer ; var scalevals iscalevaltable) ; 
var 

i, j ,k ; integer; 

p : real; 

begin 

for i := 1 to num do 

for j := 1 to scales(.i.) do begin 
P := (j-l)/(scales(.i.)-l); 
k := round(p ^ 100); 
scalevals ( . i , j . ) := k/100; 



getvalof scale (numfactor , scalevals) ; 

(*Tt****Kx*x Get estimation probability a^’*:*********) 
writeln('Get Estimation Probabilities'); 

writeln( ' ' ) ; 

writeln; 

for i := one to maxcho do 

for j := one to numfactor do 
begin 

writeln( ' (factor' , j ; 1 , ' ) ' ) : 
for k := one to scales(.j.) do 
begin 

write ('Initial State f(',j;l,') = '); 
writeln( scalevals( . j , k. ) 50 :2 , ' Cnoice C(',i:l,')') 
writeln( ' Terminal State : '); 
for 1 := one to scales(.j.) do 

write (' prob',l;l,' '); writeln; 

read estimation probability *****) 
for 1 := one to scales(.j.) do 

read (estmatrix( . j , ( i- 1 )*scales( . j . )+l<k. )) ; 
reading- 

end; (^''end k*) writeln; writeln; 

^ 7 ^ X x X A 7 ^ check and correct 
repeat 

write ( ' ' tlO) ; 

for k := one to scales(.j.) do 

write (' '); writeln; 

write( ' ' :10) ; 

for k := one to scales(.j.) do 

write (scalevals ( .j , k. ) 56 : 2 , ' '); writeln; 
writeC ':10); 

for k := one to scales(.j.) do 

write (' ');writeln; 

for k := one to scales (.j.) do 
begin 

write( ' ' :5 , i :1 , ' ' :4) ; 

for 1 := one to scales(.j.) do 

'write (estmatrix( . j , (i -1 )*scales( . j . )+k, 1 . ) 56 : 2 , ' 
writeln ; 

end; (*end k*) v;riteln; 

writein( ' goahead : Press any key, correction : "%" ' ) 
writeln; writeln,- 
readln(ch) ,- 

if ch = '%' then begin 

writeln( ' Enter Choice, row, col, prob ; '); 
readln(k, 1 , m, p); 

estmatrix( . j , (k-l)*scales( . j . )+l<ni. ) :=p; end,- 
until not(ch = '%' ) ; 

end; (*end j*) 



end; 




end; 



Procedure Get State Matrix 
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procedure Getstatmatri:{(numfactor : integer; possiblestates : integer ; 

scales -.scale table ; scalevals rscaleval table ; 
var statmatrix:statematrix) ; 



var 

i- j / K, 

ptr, loop, mult : integer; 
begin 

mult := one; 

for i := one to numfactor do 
begin 

mult := mult * scales (.i.); 
loop := possiblestates div mult; 
ptr := 0; 

for j := one to mult do 
begin 

ptr := ptr -t- one; 

if ptr > scales(.i.) then ptr := (ptr mod scales( . i . ) ) ; 
for k := one to loop do 

statmatrix( . ( j -1 )*loop-i-k. ) . column ( . i . ) :=scalevals ( . i ,ptr . ) 

end; 

end; 

end; 



* ========================================== * 

* === Procedure Print State Matrix === 

X = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = X 



procedure printstatmatrix( numfactor : integer,- possiblestates : integer ; 

statmatrix:statematrix) ; 



var 



colptr , 

scaleptr, tableptr : integer,- 

begin 



page ,- 

writeln( ' ' :57) ; 

writeln( ' Organizational States' :57); 

writeln( ' ' :57) ; 

writeln; writeln,- 

writeln( ' ' :70); 

writelni ' Number of factors ! ' :49 , numfactor I ITT 
writelni' State Combinations of Scale Values':67); 

write In ( ' ' :70) ; 

for tableptr .-= one to possiblestates do 
begin 

write(' ':23); write(tableptr :6) ; write(' ':9),- 
for Colptr := one to numfactor do 

write( statmatrix( . tableptr. ) .column( .colptr. ) : 6:2, ' ':2); 
writeln,- 
end; 

writeln(' ' :70); 

end; 



* ========================================== * 

* === Procedure State Matrix for Help === * 



procedure printhelpfile( numfactor : integer,- possiblestates : integer ,- 

statmatrix:statematrix) ; 

var 

colptr , 

scaleptr, tableptr : integer ,- 

begin 

page; 

rewrite(helpfile, 'helpfile data'); 

writelnfhelpfile , 'Organizational States' :33); 

writelnChelpfile . ' ':33); 

writeln(helpfile) ; V7riteln(helpfile ) ; 

write (helpfile, ' '),- 



45 



writeln(helpfile , ' r,-')'’ 

for tableptr := one to possiblestates do 
begin 

write (helpfile , tableptr:6); 
write(helpfile, ' ‘:9); 
for Colptr := one to numfactor do 
write (nelpf ile , statmatrix( . tableptr . ) . column ( .colptr . ) :6 :2) ; 
writeln(helpfile, ' :2); 

end; 

write fhelpfile, ' ' ) ; 

writeln(helpf ile , ' ' ) ; 

end; 



f X =========================================== A \ 

}-M == Procedure Transition Matrix == 

^ ^ ========= ================================== 

procedure gettranmatrix(numfactor : integer; possiolestates :integer ; 

choices : choice table ; scales : scale table ; 
scalevals : scalevaltable: 
estmatrix ; estimation table ; 
statmatrix ; statematrix : 
var tranmatrixitransitiontable) ; 

var 

init, next, 
cho, columns, 

pointer, firstptr, secondptr : integer; 
getprob, multiprob : real; 
found : boolean; 

begin 

for init := one to possiblestates do loopl 

for cho ;= one to choices f . init . ) do loop2 

for next := one to possiblestates do Ioop3 '^) 
begin 

multiprob ;= 1; 

for columns := one to numfactor do loop4 

begin 

pointer := 0; 

firstptr := 0; secondptr := 0; 
found := false; 

While not found do 
begin 

pointer := pointer + 1; 
if scalevals (. columns , pointer . ) = 

statmatrix( . init . ) . column! • columns . ) then 
firstptr := pointer: 
if scalevals (. columns , pointer . ) = 

statmatrix! .next. ) .column! .columns. ) then 
secondptr := pointer; 
found := not ! ! firstptr’^secondptr )=0) 
end • 

secondptr ;= !cho-l)'*^scales! .columns. )+ secondptr; 
getorob ;= estmatrix! . columns , secondptr , firstptr .) ; 
multiprob := multiprob ^ getprob; 
end; 

!^ end of loop4 

tranmatrix! . ( init- 1 ) "^choices ! . init. )+cho,next . ) := multiprob; 
end; 

!"^ end of loop3 
{'^ end of loop2 '^) 

{'^ end of loopl '^) 

end; 



k =========================================== k 

* == PROCEDURE PRINT Transition Matrix == * 

k =========================================== k 
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procedure printtranmatrix(possiblestates :integer ; choices .-choicetable ; 

tranmatrix : transitiontable) ; 



var 

columns , 

init, next : integer; 

temparray : array (.1..5.) of real; 

begin 

for init := one to possiblestates 
begin 



do (* loopl *) 



page; 
writeln 
writeln 
writeln , 
writeln; 
v;riteln; 
writeln ' 
write 
v;riteln 
write 

for columns 
write ( ' C( 
writeln; 

write P 

writeln( ' 



Transition Matrix' 



Initial State 

I 

I 

' state 

:= one 






47 

47 

47 



,init:3) ; 
■); 



to choices( .init. ) 
, columns : 1 ' ’.-lO); 



do 



77 



); 



); 



(* erase *) 

for columns -.= one to choices ( .init. ) do 
temparray ( .columns . ) := 0; 

for next := one to possiblestates do (* loop2 *) 
begin 

write (next :4) ; 

for colamns := one to choices (. init . ) do begin (* loop3 '') 
write(tranmatrix( . (init-l)*choices( . init .O+columns , next. ) ; 



(* erase *) 

temparray (. columns . ) := temparray (. columns . ) + 

tranmatrix ( . ( init-l)*choices ( .init. )+columns , next . ) ; 
end; (* erase '^) 

(* end of loop3 *) 
writeln; 
end; 

(* end of loop2 *) 

write (' '); 

writeln( ' ' ) ; 

end; 

(* end of loopl *) 

end; 
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========================================== ^ 

X === Procedure Do Goodness Measure === * 
* ========================================== * 



procedure Goodnessmeasure (numfactor .- integer; possiblestates ; integer ; 

statmatrix:statematrix; 
var goodmatrix:goodnessmatrix) ; 



var 

index, 

ideal, anti : integer; 
temp , 

max, min ; real; 



^ =========================================== 

X === Procedure Print Goodness Matrix === * 

^ =========================================== A 



procedure printgoodm.atrix; 
const 

one = 1 ; 
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var 



two = 2; 
four= 4; 
eight=8; 



begin 



loop, 

row, col ; integer; 




writelni ' 
writeln( ' 
writeln; 
vriteln; 
write ( ' 
writeln( ' 



Goodness Measurements 




write ( ' State Combination ' ) ; 

writeln(' ' : (numfactor-two) ’^eight+four , 'Goodness Remarks'); 

write (' Z(i) '); 

for loop := one to numfactor do 

write( ' val' ,1 ood: 1, ’ ' :4) ; writeln( 'value' ) ; 

write (' ^'); 

writeln( ' ' ^ • 

for row ;= one to possibles tates 3o 
begin 

write (row: 6) ; 
write( ' ' :9) ; 

for Col := one to numfactor do 

write( statmatrix( . row. ) •column( .col. ) ; 6:2, ' ':2); 

write^goodmatrix( . row. ) ; 6:2, ’ ':2); 

if row = ideal then write(’ ':5, 'ideal') 

else if row = anti then write(' ':5, 'anti-ideal'); 
writeln; 
end; 

writeln ( ' ' ) ; 

end; 

(xA Procedure Begin 
beain 

'max := -999; min := 999; 
for index ;= one to possiblestates do 
begin 

Case numfactor of 

2 : writelnC’’^ Not prepared ^^'); 

3 : begin 

temp := - (statmatrix( . index. ) .column( .one .) ) 

+(statmatrix( .index. ) .column( .two. )) 

+(statmatrix( . index. ) .column( . three . ) ) ; 
goodmatrix( . index. ) := temp; 
if temp > max then 
begin 

max ;= temp; ideal ;= index; 
end; 

if temp < min then 
begin 

min := temp; anti ;= index; 
end; 

end; 

4 : writeln(''^ Not prepared "^'); 

end: end case 

end; end for 
Printgoodmatrix; 



end; 



== Procedure Get Benfit Matrix 
procedure getbenematrix (possible states ; integer ; 
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choices : choice table ; 
tranmatrix : transitiontable ; 
goodjnatrix :goodnessmatrix; 
var benematrix:benefittable) ; 



var 



begin 



row, 

temp 



col, loop 
: real; 



integer; 



do 



loopl *) 

loop2 



') 



do {* loops *) 



end; 



for row := one to possiblestates do 
for col != one to choices (. row. ) 
begin 

temp := 0; 

for loop := one to possiblestates ^ , 

temp := temp+(tranmatrix( . (row-l)*choices( .row. )+col, loop. ) 

*(qoodmatrix( .loop. ) - goodmatrix(.row.))); 
benematrix( . row. col. ; := temp; 

(* end of loops 
end; 

(* end of loop2 *) 

(* end of loopl *) 



/ = = = = = ===== = = = = = = = = = = = = = == = = = = == === === = = = = = = N 

(* == Procedure Print Benefit Matrix == 

procedure printbenematrix(possiblestates : integer ; maxcho -.integer; 

choices :choicetable ; benematrix :benefittable) ; 



var 

row, col : integer; 

begin 



page; , 

writeln(' :47) ; 

v;riteln( ' Benefit Matrix' :47); 

writeln( ' ' :47) ; 

writeln; 

writeln; 

write ('State Z(i) '); 
for col := one to maxcho do 
write( 'C( ' ,col:l, ' ) ' , ' ' :10) ; 
writeln; 

write (' 

write In ( ' ' ) 

for row := one to possiblestates do (* loopl *) 
begin 

write ( row :4) ; 

for col := one to choices (. row. ) do (* loop2 *) 
write (benematrix( .row, col. ) :14:6) ; 

{* end of loop2 *) 
writeln; 
end; 

(* end of loopl *) 

write (' 

writeln( ' ' ) : 

end; 



); 



); 



(*** PART II. MAIN PROGRAM ***) 
begin 

(* ======== Input Data via Terminal ======= *) 

(* Step I. 

Getnumoffactor (numfactor , possiblestates , scales) ,- 
Ge tnumof choices (numf actor , possible state s , choices , maxcho) ,- 
Getestprob (numfactor , maxcho, scales , scalevals ,estmatrix) ; 

======== Get Transition Matrix ========= *) 

(* Step II. *) 

Ge t s ta tmat rix (numf actor, possible state s , scales , scalevals , statmatrix) ; 
printstatmatrix(numfactor, possiblestates , statmatrix) ,- 
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printhelpfile (numfactor ,possiblestates , statmatrix) ; 

(* Step III. *) 

Gettranmatrix (numfactor .possible states , choices, scales , scalevals , 
estmatrix .statmatrix , tranmatrix) : 
Printtranmatrix(possiblestates , choices , tranmatrix) ; 

(* ======== Get Benefit Matrix ========= *) 

(* Step IV. 

Goodnessmeasure (numfactor .possibles tates , statmatrix, goodmatrix) ; 
(* Step V. *) 

Getbenematrix (possiblestates , choices , tranmatrix, 

goodmatrix, benematrix) ; 

printbenematrix(possiblestates .maxcho , choices .benematrix) ; 
end;* 
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(* ##########**################################## *) 

* ### G C M PART III. ### *j 

### Generate Long Run Policy ### *) 

### This part processes Howard's algorithm ### *) 
/* ### main modules are Dynamic formulation, ### *) 
(* ### Resolve variable, and Setnewaction ### *) 



):t*«** get choice policy 

^ 7r:k-k7^-k-k-k-k7^-k^-k-k7^-k-k:ky^-ki^-k9z-k-k-k-k-k-kizi<:-k-k9:-k-k’k'k'k'k'k'k'k'k'k-k-k \ 

Procedure Getchoice (possible states : integer; choices : choice table ; 

tranmatrix : transitiontable ; 

benematrix ibenefittable ; var policy ;policytable); 



type 

markovtable 
de terminval 

var 

index 

i/3 . 

maxincome 



array f . one . .maxstate , one . .maxs tateetc . ) of real; 
array (. one . .maxs tateetc . ) of real; 

: integer; 

: integer; 

; real; 



markov 

resolution 

newpolicy 



markovtable ; 
de terminval; 
policytable ; 



reached, matched, 

quitnow, inforced : boolean; 

== PROCEDURE Initialize policy Table == 

procedure initialize (possibles tates : inteqer ; choices .-choice table ; 

benematrix ;benel:ittable ; var policy rpolicytable ) ; 



var 

row, col ; integer; 
max : real; 
begin 

for row := one to possiblestates do 
begin 

max ;= -999; 

for col ;= one to choices (. row. ) do 
If benematrix( .row,col. ) > max then 
begin 

max := benematrix( . row,col. ) ; 
policy( . row. ) := col; 
end; 

end; 

end; 

== PROCEDURE Dynamic Formulation == M 

procedure dynamic_formulation(vi : integer; possiblestates ; integer; 

choices :choicetable ; tranmatrix: transitiontable ; 
benematrix :benef ittable ; policy .-policytable ; 
var markov :markovtable); 



var 

row, col : integer; 

begin 

(* fill matrix with variable coefficient *) 
for row := one to possiblestates do 
markov (. row, one . ) -.= 1.0; 
for row := one to possiblestates do 

for col := one to possiblestates do 
If row = col then 

markov( . row , col-i-1 . ) : = 

1- (tranmatrix( . (row-1 )*choices( . row. )-hpolicy( . row. ) , col. ) ) 

else 
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markov( . row, col+1 .) := 

- ( tranmatrix( . ( row- 1 ) ’^choice s ( . row . )+policy ( . row . ) , col . ) ) ; 
for row := one to possiblestates do 

markov( . row,possiblestates+2 . ) := benematrix( . r ow, policy ( . row. ) . ) ; 

remove an arbitary vatiable v(i) 
xor row ;= one to possiblestates do 

for col := vi + one to possiblestates + one do 
markov( . row, col . ) := markov( .row,col+l . ) ; 

end; 



* == PROCEDURE Resolve all variables == * 

X =========================================== X 



procedure Resolvevariable (vi :inteqer ; ntinteger,- 

var markov tmarkovtable ; 
var resolution :determinval) ; 

var 

i,j,k : integer; 

multfac , 

temp : real; 

begin 

/:r**A*x*x* manipulate markov matrix ***********) 
for i := 1 to n-1 do begin 
if markov( . i , i . ) <> 1 then 
begin 

multfac := 1/ (markov( . i , i . ) ) ; 
for j := i to n+1 do 

markov( . i , j . ) := markov( . i , j . ) * multfac; 

end; 

for j := i+1 to n do 
begin 

multfac := markov( . j , i . ) ; 
for k := i to n+1 do 

markov( . j , k. ) := markov{ . j ,k. ) - (multfac * markov( . i, k. ) ) ; 

end; 

end; 

^•k'kkkkk-k'kk find SOlution ’^’kk'kk'kkkkkkk ^ 
re solution ( ,n. ) := markov ( .n,n+l . )/markov( .n,n. ) ; 
for i := n-1 dovmto 1 do 
begin 

temp := 0^- 

for j := 1+1 to n do 
temp := temp + 

(markov( . i, j . ) resolution( . j . ) ) ; 
resolution( . i. ) := markov( . i,n+l . ) - temp; 
end; 

tor j := n downto vi + 1 do 

resoiution( . j+1 . ) := resolution(.j.); 
resolution( . vi+1 . ) := 0; 
end; 



X =========================================== X 

== PROCEDURE Set New Action == 

X =========================================== X 



procedure setnewaction(possiblestates .-integer; choices rchoicetable ; 

tranmatrix : transitiontable ; 
benematrix :benef it tablet- 

re solution tdeterminval ; var newpolicy : policy table ; 
policy ipolicytable) ; 

type 

eval_property = record 
ptr : integer; 
val : real; 
end; 



var 



col, cho, loop, 

i, j , k, selectcode : integer,- 

temp, dynamic , max: real; 

property : array ( .one . .maxchoice . ) of eval_property 

begin 

for loop := one to possiblestates do 
begin 

max := -999; 

for cho := one to choices (. loop. ) do 
begin 

dynamic -.= 0; 

for col := one to possiblestates do begin 

dynamic ;=dynamic + 

(tranmatrix( . (loop-l)*choices( .loop, )•^cho,col. ) * 

resolution( .col-t-one . ) ) ; 

end; 

dynamic :=dynamic + benematrix( . loop, cho. ) ,- 
property^ .cho. ) .ptr := cho; 
property( .cho. ) .val := dynamic; 
end; (* end of choice *) 

(* sorting *) 

for i := choices (. loop. ) downto two do 
for j := one to i-1 do 

if property( .i. ) .val > property( . j . ) .val then begin 
temp := property(.j.).val; 
property^ . j . ) . val := property(.i.).val; 
property( . 1 . ) . val ;= temp; 
k := property( . j .) .ptr; , 

property! .per := property(.i.).ptr; 
property! . 1 .) .ptr := k; end; 

(** equality 

if (property! . 1 .) .val >= 0) and !property! . 2 . ) .val >= 0) then 
selectcode := 1; 

if !property! . 1 . ) . val >= 0) and !property! . 2 . ) . val < 0) then 

selectcode -.= 2; 
if !property! . 1 . ) . val < 0) then 
selectcode ;= 3; 
case selectcode of 

1 : if ! !property ! . 1 . ) .val-property! . 2 . ) .val)/ 

property! . 1 .) .val) <= 0.0001 then !^ identity *) 
newpolicy! .loop. ) := policy! . loop. ) 
else nev;policy! . loop. ) ;= property! . 1 .) .ptr ; 

2 : newpolicy! . loop . ) .-= property! . 1 .) .ptr ; !* nonidentity *) 

3 : if ! !property! . 2 .) .val-property! . 1 .) .val)/ 

property! . 1 .) .val) > O.UOOl then (* nonidentity *) 
newpolicy! . loop . ) := property! . 1 .) .ptr 
else newpolicy! . loop. ) -.= policy! .loop. ) 

end; 

end; !^ end of loop *) 

end; 



!*** PART III MAIN PROGRAM ***) 
begin 

vi := possiblestates; 
repeat 

!^ Step I. *) 

Initialize ! possiblestates , choices ,benematrix, policy) ; 
maxincome .*= -999.0; 
inforced ;= false,- 
repeat 

!* Step II. *) 

Dynamic_formulation!vi , possiblestates , choices , 

tranmatrix, benematrix, policy, markov); 

!* Step III. *) 

Resolvevariable !vi , possiblestates ,markov, resolution) ; 
for i := 1 to possiblestates 1 do 
{* Step IV. =^) 

setnewaction!possible states , choices , tranmatrix, benematrix. 
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resolution;newpolicy, policy) ; 
guitnow := false; 

if maxincome <= resolution( . one . ) then 
begin 

index := 0; 
quitnow := true; 
repeat 

index := index + 1; 

reached := (index >= possiblestates) ; 
matched := (policy( . index. )=newpolicy( . index. ) ) ; 
quitnow := quitnow and matched^- 
policy (. index. ) := newpolicy( . index. ) ; 
until reached; 

if quitnov; and (resolution( .one . ) < 0) then inforced := true 
else maxincome := resolution( . one . ) ; 

end 

else inforced := true- ("^endif maxincome"^) 
until (guitnow or inforced); 
vi := VI- 1 • 

if (vi = 0) and (not quitnow) then writeuser (IMPOSSIBLE) ; 
until ((quitnow and (not inforced)) or (vi=0)); 
vi := VI + 1 ; 

gain := resolution( .one. ) ; (’^printed on policytable"^) 
end; 
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* ### ### * 

Ifit# G C M PART IV. ### *) 

(* ### *) 

/ i^:kii:k-k:k-k7K:k:k7<9:9^i<:k9:ikikik:k:k9^-k9^:k:k:ki<:ki^:k:k-k9i:k9z:k:kik:k:ki^iki<iki^ \ 

(***^ INTERACTION ***) 

Procedure inter act ion (possiblest at es : integer ; policy : policy table) ; 
type 

elementtable = array (. one . .maxfactor . ) of real; 
oneline = packea array( .one. .seventy. ) of char; 

var 

current : integer; 

elements : elementtable; 

line ; oneline; 

yesno : char; 

doall, nomore, 
needhelp ; boolean; 



:k ——~zz— — — — — — — = — "k 

* == Do Partial Decision policy == * 

* ========================================== * 



procedure dopartial(possiblestates :integer; policy :policytable) ; 
begin 

writeln('Do you want to see Helpfile for current problem ? y/n'); 
readln(yesno) ; 

needhelp := (yesno='Y') or (yesno='y'); 
if needhelp then begin 

reset (helpfile, 'helpfile data'); 
while not eof (helpfile) do begin 
readln(helpfile , line); 
writeln(line) ; end; 
end; 



repeat 

writeln( ' What is your current state ? ===> Type n'); 

readln(current) ; 

until (current > 0) and (current <= possiblestates) ; 
writeln; 

write P Current State ; current :2, ' ); 

v;riteln( ' Best Choice : policy( .current. ) :2) ; 

writeln; 
end; 



* ========================================== * 

== PRINT POLICY TABLE == * 

k - — - — - — - — - — - — — — — - — — — — — 



procedure printpolicy(possiblestates :integer ; policy -.policytable) ; 



var 

loop, cnt : integer; 

begin 
page ; 

writeln ( ' ' : 21 ) ; 

writeln ( ' Decision Choices ' :27 ) ; 

writeln ( ' ' :27 ) ,• 

writeln; 

writeln; 

writeln? ' State Choice Policy'); 

writeln? ' 2(i) C(k) '); 

v;riteln( ' ' ) ; 

writeln; 
cnt := 0; 

for loop := one to possiblestates do (* loop2 *) 
begin 

writeln(loop :4, ' ' :30, policy( . loop . ) :3) ; 



cnt := cnt + 1 ; 

if (cnt mod 3) = 0 then readln(wait) ; 
end; 

writeln( ' 

writeln; 

writeln('set arbitary v(', vi:2, ') to O'); 
writeln; 

writeln( ' maxincome per period : gain); 

writeln; 



page ; 
end; 



); 



begin 
reoeat 
‘page ; 

writeln('Do you want all decision policy ? y/n'); 
readln(yesno) ; 

doall := (yesno='y) or (yesno='y‘); 

if doall then printpolicy (possiblestates , policy) 
else dopartial(possiblestates , policy) ; 

writeln('Do you have another ploblem ?'); 
readln(yesno) ; 

nonore := (yesno='N') or (yesno='n'); 
until nomore; 
end; 
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(* ########################################## *) 

U ### G C M PART V. ### *j 

(* ### Exit Garbage Can Prog. ### *) 

)**** get boolean value 

^ A A A aA A:A:A:A: AA AA A A A:^i: A Ax:ArA A A \ 

Procedure Getboolean(var Exit :boolean) ; 
beg^in 

exit ;= true; 
page; 
end; 



r'k'k'k'k'k'k'k:k'ki^-k'k-k'k-k^^'k^:k^'kiK^^i^:ki^-k-k'k^:k*:-ki^-k'k-k:k:k'k'k^i^^ 

End of Garbage Can Model Program 



)***** MAIN PROGRAM ***** 

begin 

Quitnow := false; 

While not quitnow do begin 
if getcommand(command) then 
Case command of 

EXECGCM : begin 

Getmatrix(possiblestates , choice s , 

tranmatrix,benematrix) ; 
Getchoice (possiblestates , choices , 

tranmatrix.benematrix, policy) 
Interaction (possiblestates .policy) ; 
end; 

EXECEXIT : Getboolean(Quitnow) ; 
end 

else Writeuser (BADLINE) ; 
end; 
end. 
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APPENDIX B 
USER MANUAL 



PGCM Program, 1987 



I. PROGRAM NAME : pgcmprog (written in Waterloo pascal language) 

II. PURPOSE : Get a set of choices available in a specific organization 

problem 

I I I. TO USE: 



1. Before Execution 

1) Formulate problem and set alternative actions 

2) Turn on your terminal 

3) LOGIN userid 

4) ENTER PASSWORD(IT WILL NOT APPEAR WHEN TYPED): 

5) Memorv extention (if necessary) 

: DEf STOR 1500k 
: I CMS 

6) Execute garbage can program 

: pw gcmprog pascal 

2. During Execution 

1) Select menu option 



1 ExecGCM 

2 ExitGCM 



2) Enter number of scale points for each factor 
i.e> factor 1 : 3 
factor 2 : 2 
factor 3 : 2 

======> possible states : 3 x 2 x 2 = 12 

4) Enter numtber of choices for each state 
i.e> state 1 ? 2 
state 2 ? 2 
state 3 ? 3 
state 4 ? 3 
state 5 ? 3 
state 6 ? 3 
state 7 ? 2 
state 8 ? 2 
state 9 ? 3 
state 10? 3 
state 11? 3 
state 12? 3 

======> maxchoices : 3 

4) Enter estimation probabilities 

if user has the following input data. 



cho 


factorl (P) 

P 

0.0 0.5 1.0 cho 


factor2(S) 

S 

0.0 1.0 cho 


factor3(E ) 
E 

0.0 1.0 


1 

1 

cho 1 


0.2 0.4 0.3 1 
0.3 0.5 0.5 1 
0.5 0.1 0.2 

0.0 0.5 1.0 cho 


0.10.6 1 

0.9 0.4 1 

0.0 1.0 cho 


0.3 0.6 
0.7 0.4 

0.0 1.0 


2 

2 

cho 


1 0.1 0.3 0.2 2 

0.5 0.3 0.2 2 

I 0.4 0.4 0.6 

0.0 0.5 1.0 cho 1 


0.50.1 2 

0.50.9 2 

0.0 1.0 cho 


0.2 0.9 
0.8 0.1 

0.0 1.0 


3 


0.1 0.7 0.2 3 


1 0.3 0.3 3 


0.4 0.5 



58 



3 0.1 0.2 0.3 3 1 0.2 0.7 3 | 0.6 0.5 

3 0.8 0.1 0.5 

Interact with the folov;ing manner 



(factorl) 

Initial State f(l) = 0.00 Choice C(l) 

Terminal State 
probl prob2 prob3 ? 

"072 OTl 075 

^ rectangle • input data 

Initial State f(l) = 0.50 Choice C(l) 

Terminal State 
probl prob2 prob3 ? 

"074 075 07l 



Initial State f(l) = 0.10 Choice C(l) 

Terminal State 
probl prob2 prob3 ? 



0 . 3 0 . 5 0 . 2 



(factor2) 



(factor3) 



* choice 2 and choice 3 operations are the same 



3. After Execution 

1) Do you want all decision policy ? y/n 

yes 

display all choice policies 
no 

Do you want to see Helpfile for current problem ? y/n 
yes 

display organizational states for memory aids 
What is your current state ? ===> Type n 

no 

What is your current state ? ===> Type n 

2) Do you have another ploblem ? 

yes 

go to procedure 3.1 
no 



go to procedure 2.1 



4. Get results 

1) PRINT OUT 

: PRINT gcmprog listing 
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2) BROWSE 
: FLIST 
: use PF k 



5. Turn off 
: LOGOFF 



APPENDIX C 

OFFENSIVE OPERATION EXAMPLE 



5 :k:k9i:9i::k:k:k7^-k:k7K:k:k9z:k9z7^:k:k:k:k:k:k9i:'k:k:k9i::k'k:k:k9i:k 
:k:k :k:k 

** step I ; User Interaction ** 



I. Formulate problem and prepare estimation probabilities 

P : Importance of problems to be solved 

S : Degree of effectiveness in problem-solving 

E : Potential energy of participants 

pl=0 No significant problem regarding attack forces, 
mission load, weather, relation with consequent 
military operation 

p2=.5 Moderate shortage of attacking forces, not good 
weapon system good weather, a certain time delay 
to the consequent operation 

p3=l Acute shortage of attacking forces, big mission 
load, bad weather, a tremendous time delay to the 
consequent operation 

S1=0 Most of personnel have no experience in the battle 
field, poor coordination with adjacent unit, 
poor performance weapon systems 

S2=.5 Some personnel have an experience in the battle 
field, appropriate coordination and reasonable 
attack-defense forces ratio, good performance 
weapon systems, good logistic support systems 

S3=l Some personnel have an experience in the battle 
field, excellent coordination, best attack-defense 
forces ratio, excellent performance weapon systems 
, sufficient logistic support systems 

E1=0 Not quite proud of their operations , passive action 

E2=l High morale, high responsibility 



P S E 



Choice 


0.00 


0.50 


1.00 


0.00 


o.io 


1.00 


0.00 


1.00 


1 


0.98 


0.19 


0.01 


0.97 


0.01 


0.01 


0.95 


0.01 


1 


0.01 


0.80 


0.02 


0.02 


0.70 


0.01 


0.05 


0.99 


1 


0.01 


0.01 


0.97 


0.01 


0.29 


0.98 






2 


0.98 


0.70 


0.10 


0.20 


0.01 


0.01 


0.20 


0.01 


2 


0.01 


0.29 


0.50 


0.70 


0.19 


0.01 


0.80 


0.99 


2 


0.01 


0.01 


0.40 


0.10 


0.80 


0.98 






3 


0.98 


0.80 


0.39 


0.90 


0.01 


0.01 


0.70 


0.05 


3 


0.01 


0.19 


0.60 


0.09 


0.39 


0.01 


0.30 


0.95 
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3 


0.01 


0.01 


0.01 


0.01 


0.60 


0.98 






4 


0.30 


0.10 


0.20 


0.30 


0.20 


0.30 


0.20 


0.30 


4 


0.60 


0.80 


0.60 


0.60 


0.60 


0.40 


0.80 


0.70 


4 


0.10 


0.10 


0.20 


0.10 


0.20 


0.30 







II. Execution 



Select Menu Option 

1. ExecGCM (Execute GCM Program 

2. ExecExit(Execution stop 



Enter # of scale points for each factor ; 



factor 


1 : 


3 


factor 


2 : 


3 


factor 


3 : 


2 



goahead : Press any key, correction ; ”%" 



Get Number of Choices for each State Z(i) i 
State Z(i) of choices 



1 ? 4 

2 ? 4 

3 ? 4 

4 ? 4 

5 ? 4 

6 ? 4 

7 ? 4 

3 ? 4 

9 ? 4 

10 ? 4 

11 ? 4 

12 ? 4 

13 ? 4 

14 ? 4 

15 ? 4 

16 ? 4 

17 ? 4 

18 ? 4 



goahead : Press any key, correction : “%" 
Get Estimation Probabilities 



(factorl) 



Initial 

Terminal 


State 

State 


f(l) = 


0.00 


Choice 


C(l) 


probl 


prob2 


prob3 ? 


0.98 


0.19 0. 


01 


Initial 

Terminal 


State 

State 


f(l) = 


0.50 


Choice 


C(l) 


probl 


prob2 


prob3 ? 


0.01 


0.80 0. 


02 


Initial 

Terminal 


State 

State 


f(l) = 


1.00 


Choice 


C(l) 


probl 


prob2 


prob3 ? 


0.01 


0.01 0. 


97 



1 



18 
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{* Display Input Data *) 
OTOO 030 TToF 



1 

1 

1 

goahead ; 


0.98 0.19 0.01 
0.01 0.80 0.02 
0.01 0.01 0.97 

: Press any key, correction : "%" 



Repeat this step for remaining (n-l)factors 
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★ A iK:k 

Step II : Generate Matrices 

"k-k kk 

kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk 







Transition 


Matrix 




Initial 


State : Z 1 








state 


cu) 


C(2) 


C(3) 


C(4) 


]_ 


0.903070 


0.039200 


0.617400 


0.018000 


2 


0.047530 


0.156800 


0.264600 


0.072000 


3 


0.018620 


0.137200 


0.061740 


0.036000 


4 


0.000930 


0.548800 


0.026460 


0,144000 


5 


0.009310 


0.019600 


0.006860 


0.006000 


6 


0.000490 


0.073400 


0.002940 


0.024000 


7 


0.009215 


0,000400 


0.006300 


0.036000 


3 


0.000435 


0.001600 


0,002700 


0.144000 


Q 


0.000190 


0.001400 


0.000630 


0,072000 


id 


0.000010 


0.005600 


0.000270 


0.288000 


11 


0.000095 


0.000200 


0.000070 


0.012000 


12 


0,000005 


0.000800 


0.000030 


0.048000 


13 


0.009215 


0.000400 


0.006300 


0.006000 


14 


0.000435 


0.001600 


0.002700 


0.024000 


15 


0.000190 


0.001400 


0.000630 


0.012000 


16 


0.000010 


0.005600 


0,000270 


0.048000 


17 


0.000095 


0.000200 


0.000070 


0.002000 


18 


0.000005 


0.000800 


0.000030 


0.008000 


Initial 


State : Z 2 








state 


CTT5 




cm 


cm 


1 


0.009506 


0.001960 


0.044100 


0.027000 


2 


0.941094 


0.194040 


0.837900 


0.063000 


3 


0.000196 


0.006860 


0.004410 


0.054000 


4 


0,019404 


0.679140 


0.083790 


0.126000 


5 


0.000098 


0.000980 


0,000490 


0.009000 


6 


0.009702 


0.097020 


0.009310 


0.021000 


7 


0.000097 


0.000020 


0.000450 


0,054000 


8 


0.009603 


0.001980 


0.008550 


0.126000 


9 


0.000002 


0,000070 


0,000045 


0.103000 


10 


0.000198 


0.006930 


0.000855 


0,252000 


11 


0.000001 


0.000010 


0,000005 


0.018000 


12 


0.000099 


0.000990 


0.000095 


0.042000 


13 


0.000097 


0,000020 


0.000450 


0.009000 


14 


0.009603 


0,001980 


0.008550 


0,021000 


15 


0,000002 


0,000070 


0.000045 


0.018000 


16 


0.000198 


0.006930 


0.000855 


0,042000 


17 


0.000001 


0,000010 


0.000005 


0.003000 


18 


0.000099 


0.000990 


0.000095 


0.007000 



64 



Initial State : Z 3 



state 


— cm 


C(2) 


cm 


C(4) 


1 


0.009310 


0.001960 


0.006860 


0.012000 


2 


0.000490 


0.007840 


0.002940 


0.048000 


3 


0.651700 


0.037240 


0.267540 


0.036000 


4 


0.034300 


0.148960 


0.114660 


0.144000 


5 


0.269990 


0.156800 


0.411600 


0.012000 


6 


0.014210 


0.627200 


0.176400 


0.048000 


7 


0.000095 


0.000020 


0.000070 


0.024000 


8 


0.000005 


0.000080 


0.000030 


0.096000 


9 


0.006650 


0.000380 


0.002730 


0.072000 


10 


0.000350 


0.001520 


0.001170 


0.288000 


11 


0.002755 


0.001600 


0.004200 


0.024000 


12 


0.000145 


0.006400 


0.001800 


0.096000 


13 


0.000095 


0.000020 


0.000070 


0.0040CO 


14 


0.000005 


0.000080 


0.000030 


0.016000 


15 


0.006650 


0.000380 


0.002730 


0.012000 


16 


0.000350 


0.001520 


0.001170 


0.048000 


17 


0.002755 


0.001600 


0.004200 


0.004000 


18 


0.000145 


0.006400 


0.001800 


0.016000 



Initial 


State ; Z 4 








state 


cm 


cm 


cTD 


cm 


1 


0.000098 


0.000098 


0.000490 


0.018000 


2 


0.009702 


0.009702 


0.009310 


0.042000 


3 


0.006860 


0.001362 


0.019110 


0.054000 


4 


0.679140 


0.184338 


0.363090 


0.126000 


5 


0.002842 


0.007840 


0.029400 


0.018000 


6 


0.281358 


0.776160 


0.558600 


0.042000 


7 


0.000001 


0.000001 


0.000005 


0.036000 


8 


0.000099 


0.000099 


0.000095 


0.084000 


9 


0.000070 


0.000019 


0.000195 


0.103000 


10 


0.006930 


0.001881 


0.003705 


0.252000 


11 


0.000029 


0.000080 


0.000300 


0.036000 


12 


0.002371 


0.007920 


0.005700 


0.084000 


13 


0.000001 


0.000001 


0.000005 


0.006000 


14 


0.000099 


0.000099 


0.000095 


0.014000 


15 


0.000070 


0.000019 


0.000195 


0.018000 


16 


0.006930 


0.001881 


0.003705 


0.042000 


17 


0.000029 


0.000080 


0.000300 


0.006000 


18 


0.002871 


0.007920 


0.005700 


0.014000 



65 



Initial State Z 5 



state 


cm 


C(2) 


C(3) 


C(4) 


1 


0.009310 


0.001960 


0.006860 


0.018000 


2 


0.000490 


0.007840 


0.002940 


0.072000 


3 


0.009310 


0.001960 


0.006860 


0.024000 


4 


0.000490 


0.007840 


0.002940 


0.096000 


5 


0.912380 


0.192080 


0.672280 


0.018000 


6 


0.048020 


0.763320 


0.288120 


0.072000 


7 


0.000095 


0.000020 


0.000070 


0.036000 


8 


0.000005 


0.000030 


0.000030 


0.144000 


9 


0.000095 


0.000020 


0.000070 


0.048000 


10 


0.000005 


0.000080 


0.000030 


0.192000 


11 


0.009310 


0.001960 


0.006860 


0.036000 


12 


0.000490 


0.007840 


0.002940 


0.144000 


13 


0.000095 


0.000020 


0.000070 


0.006000 


14 


0.000005 


0.000080 


0.000030 


0.024000 


15 


0.000095 


0.000020 


0.000070 


0.008000 


16 


0.000005 


0.000080 


0.000030 


0.032000 


17 


0.009310 


0.001960 


0.006860 


0.006000 


13 


0.000490 


0.007340 


0.002940 


0.024000 



Initial 


State : Z 6 








stare 


cm 


cm 


cm 


cm 


1 


0.000098 


0.000098 


0.000490 


0.027000 


2 


0.009702 


0.009702 


0.009310 


0.063000 


3 


0.000098 


0.000098 


0.000490 


0.036000 


A 


0.009702 


0.009702 


0.009310 


0.084000 


5 


0.009604 


0.0096G4 


0.048020 


0.027000 


6 


0.950796 


0.950796 


0.912380 


0.063000 


7 


0.000001 


0.000001 


0.000005 


0.054000 


8 


0.000099 


0.000099 


0.C00095 


0.126000 


9 


0.000001 


0.000001 


0.000005 


0.072000 


10 


0.000099 


0.000099 


0.000095 


0.168000 


11 


0.000098 


0.000093 


0.000490 


0.054000 


12 


0.009702 


0.009702 


0.009310 


0.126000 


13 


0.000001 


0.000001 


0.000005 


0.009000 


14 


0.000099 


0.000099 


0.000095 


0.021000 


15 


0.000001 


0.000001 


0.000005 


0.012000 


16 


0.000099 


0.000099 


0.000095 


0.028000 


17 


0.000098 


0.000098 


0.000490 


0.009000 


18 


0.009702 


0.009702 


0.009310 


0.021000 



66 



Initial State : Z 7 



state 


CTT5 


C(2) 


CIT5 


C(4) 


1 


0.175086 


0.028000 


0.504000 


0.006000 


2 


0.009215 


0.112000 


0.216000 


0.024000 


3 


0.003610 


0.093000 


0.050400 


0.012000 


4 


0.000190 


0.392000 


0.021600 


0.048000 


5 


0.001805 


0.014000 


0.005600 


0.002000 


6 


0.000095 


0.056000 


0.002400 


0.008000 


7 


0.737200 


0.011600 


0.119700 


0.046000 


8 


0.038800 


0.046400 


0.051300 


0.192000 


9 


0.015200 


0.040600 


0.011970 


0.096000 


10 


0.000800 


0.162400 


0.005130 


0.384000 


11 


0.007600 


0.005300 


0.001330 


0.016000 


12 


0.000400 


0.023200 


0.000570 


0.064000 


13 


0.009215 


0.000400 


0.006300 


0.006000 


14 


0.000485 


0.001600 


0.002700 


0.024000 


15 


0.000190 


0.001400 


0.000630 


0.012000 


16 


0.000010 


0.005600 


0.000270 


0.048000 


17 


0.000095 


0.000200 


0.000070 


0.002000 


IS 


0.000005 


0.000800 


0.000030 


0.008000 



Initial 


State : Z 8 








state 


cTT5 


cT2) 


CU) 


cT4) 


1 


0.001843 


0.001400 


0.036000 


0.009000 


2 


0.182457 


0.138600 


0.684000 


0.021000 


3 


0.000038 


0.004900 


0.003600 


0.018000 


4 


0.003762 


0.485100 


0.068400 


0.042000 


5 


0.000019 


0.000700 


0.000400 


0.003000 


6 


0.001881 


0.069300 


0.007600 


0.007000 


7 


0.007760 


0.000580 


0.008550 


0.072000 


8 


0.768240 


0.057420 


0.162450 


0.168000 


9 


0.000160 


0.002030 


0.000855 


0.144000 


10 


0.015840 


0.200970 


0.016245 


0.336000 


11 


0.000080 


0.000290 


0.000095 


0.024000 


12 


0.007920 


0.028710 


0.001805 


0.056000 


13 


0.000097 


0.000020 


0.000450 


0.009000 


14 


0.009603 


0.001980 


0.008550 


0.021000 


15 


0.000002 


0.000070 


0.000045 


0.018000 


16 


0.000198 


0.006930 


0.000855 


0.042000 


17 


0.000001 


0.000010 


0.000005 


0.003000 


18 


0.000099 


0.000990 


0.000095 


0.007000 



67 



Initial State : Z 9 



state 


C(1) 




cTT5 


cJa) 


1 


0.001305 


0.001400 


0.005600 


0.004000 


2 


0.000095 


0.005600 


0.002400 


0.016000 


3 


0.126350 


0.026600 


0.218400 


0.012000 


4 


0.006650 


0.106400 


0.093600 


0.048000 


5 


0.052345 


0.112000 


0.336000 


0.004000 


6 


0.002755 


0.448000 


0.144000 


0.016000 


7 


0.007600 


0.000580 


0.001330 


0.032000 


3 


0.000400 


0.002320 


0.000570 


0.128000 


9 


0.532000 


0.011020 


0.051870 


0.096000 


10 


0.023000 


0.044080 


0.022230 


0.384000 


11 


0.220400 


0.046400 


0.079800 


0.032000 


12 


0.011600 


0.185600 


0.034200 


0.128000 


13 


0.000095 


0.000020 


0.000070 


0.004000 


14 


0.000005 


0.000080 


0.000030 


0.016000 


15 


0.006650 


0.000380 


0.002730 


0.012000 


16 


0.000350 


0.001520 


0.001170 


0.048000 


17 


0.002755 


0.001600 


0.004200 


0.004000 


18 


0.000145 


0.006400 


0.001800 


0.016000 



Initial 


State : Z 10 








state 


cm 


cm 


cm 


cm 


1 


0.000019 


0.000070 


0.000400 


0.006000 


O 


0.001881 


0.006930 


0.007600 


0.014000 


3 


0.001330 


0.001330 


0.015600 


0.018000 


4 


0.131670 


0.131670 


0.296400 


0.042000 


5 


0.000551 


0.005600 


0.024000 


0.006000 


6 


0.054549 


0.554400 


0.456000 


0.014000 


7 


0.000080 


0.000029 


0.000095 


0.048000 


8 


0.007920 


0.002871 


0.001805 


0.112000 


9 


0.005600 


0.000551 


0.003705 


0.144000 


10 


0.554400 


0.054549 


0.070395 


0.336000 


11 


0.002320 


0.002320 


0.005700 


0.048000 


12 


0.229680 


0.229680 


0.108300 


0.112000 


13 


0.000001 


0.000001 


0.000005 


0.006000 


14 


0.C00099 


0.000099 


0.000095 


0.014000 


15 


0.000070 


0.000019 


0.000195 


0.018000 


16 


0.006930 


0.001881 


0.003705 


0.042000 


17 


0.000029 


0.000080 


0.000300 


0.006000 


18 


0.002871 


0.007920 


0.005700 


0.014000 



68 



Initial State : Z 11 



state 


cdl 


cID 


cTD 


C(4) 


1 


0.001805 


0.001400 


0.005600 


0.006000 


2 


0.000095 


0.005600 


0.002400 


0.024000 


3 


0.001605 


0.001400 


0.005600 


0.008000 


4 


0.000095 


0.005600 


0.002400 


0.032000 


5 


0.176890 


0.137200 


0.548800 


0.006000 


6 


0.009310 


0.548800 


0.235200 


0.024000 


7 


0.007600 


0.000530 


0.001330 


0.048000 


3 


0.000400 


0.002320 


0.000570 


0.192000 


9 


0.007600 


0.000580 


0.001330 


0.064000 


10 


0.000400 


0.002320 


0.000570 


0.256000 


11 


0.744800 


0.056840 


0.130340 


0.048000 


12 


0.039200 


0.227360 


0.055860 


0.192000 


13 


0.000095 


0.000020 


0.000070 


0.006000 


14 


0.000005 


0.000080 


0.000030 


0.024000 


15 


0.000095 


0.000020 


0.000070 


0.008000 


16 


0.000005 


0.000080 


0.000030 


0.032000 


17 


0.009310 


0.001960 


0.006860 


0.006000 


18 


0.000490 


0.007840 


0.002940 


0.024000 



Initial 


State ; Z 12 








state 


cTTJ 


cTD 


CT3} 


CT4) 


1 


0.000019 


0.000070 


0.000400 


0.009000 


2 


0.001881 


0.006930 


0.007600 


0.021000 


3 


0.000019 


0.000070 


0.000400 


0.012000 


4 


0.001881 


0.006930 


0.007600 


0.028000 


5 


0.001862 


0.006860 


0.039200 


0.009000 


6 


0.184338 


0.679140 


0.744800 


0.021000 


7 


0.000080 


0.000029 


0.000095 


0.072000 


8 


0.007920 


0.002871 


0.001805 


0.168000 


9 


0.000080 


0.000029 


0.000095 


0.096000 


10 


0.007920 


0.002871 


0.001805 


0.224000 


11 


0.007840 


0.002842 


0.009310 


0.072000 


12 


0.776160 


0.281358 


0.176890 


0.168000 


13 


0.000001 


0.000001 


0.000005 


0.009000 


14 


0.000099 


0.000099 


0.000095 


0.021000 


15 


0.000001 


0.000001 


0.000005 


0.012000 


16 


0.000099 


0.000099 


0.000095 


0.028000 


17 


0.000098 


0.000098 


0.000490 


0.009000 


18 


0.009702 


0.009702 


0.009310 


0.021000 



69 



Initial State : Z 13 



state 


cirj 


C{2) 


C(3) 


C(4) 


1 


0.009215 


0.004000 


0.245700 


0.012000 


2 


0.000485 


0.016000 


0.105300 


0.048000 


3 


0.000190 


0.014000 


0.024570 


0.024000 


4 


0.000010 


0.056000 


0.010530 


0.096000 


5 


0.000095 


0.002000 


0.002730 


0.004000 


6 


0.000005 


0.008000 


0.001170 


0.016000 


7 


0.018430 


0.020000 


0.378000 


0.036000 


a 


0.000970 


0.080000 


0.162000 


0.144000 


9 


0.000380 


0.070000 


0.037800 


0.072000 


10 


0.000020 


0.280000 


0.016200 


0.288000 


11 


0.000190 


0.010000 


0.004200 


0.012000 


12 


0.000010 


0.040000 


0.001800 


0.048000 


13 


0.893855 


0.016000 


0.006300 


0.012000 


14 


0.047045 


0.064000 


0.002700 


0.048000 


15 


0.018430 


0.056000 


0.000630 


0.024000 


16 


0.000970 


0.224000 


0.000270 


0.096000 


17 


0.009215 


0.008000 


0.000070 


0.004000 


18 


0.000485 


0.032000 


0.000030 


0.016000 



Initial 


state : Z 14 








state 


cIT) 


cTD 


CTTJ 




1 


0.000097 


0.000200 


0.017550 


0.018000 


2 


0.009603 


0.019800 


0.333450 


0.042000 


3 


0.000002 


0.000700 


0.001755 


0.036000 


4 


0.000198 


0.069300 


0.033345 


0.084000 


5 


0.000001 


0.000100 


0.000195 


0.006000 


6 


0.000099 


0.009900 


0.003705 


0.014000 


7 


0.000194 


0.001000 


0.027000 


0.054000 


3 


0.019206 


0.099000 


0.513000 


0.126000 


9 


0.000004 


0.003500 


0.002700 


0.108000 


10 


0.000396 


0.346500 


0.051300 


0.252000 


11 


0.000002 


0.000500 


0.000300 


0.018000 


12 


0.000198 


0.049500 


0.005700 


0.042000 


13 


0.009409 


0.000800 


0.000450 


0.018000 


14 


0.931491 


0.079200 


0.008550 


0.042000 


15 


0.000194 


0.002800 


0.000045 


0.036000 


16 


0.019206 


0.277200 


0.000855 


0.084000 


17 


0.000097 


0.000400 


0.000005 


0.006000 


18 


0.009603 


0.039600 


0.000095 


0.014000 



70 



Initial State : Z 15 



state 


OT5 


cm 


cm 


C(4) 


1 


0.000095 


0.000200 


0.002730 


0.008000 


2 


0.000005 


0.000800 


0.001170 


0.032000 


3 


0.006650 


0.003800 


0.106470 


0.024000 


4 


0.000350 


0.015200 


0.045630 


0.096000 


5 


0.002755 


0.016000 


0.163800 


0.008000 


6 


0.000145 


0.064000 


0.070200 


0.032000 


7 


0.000190 


0.001000 


0.004200 


0.0240C0 


8 


0.000010 


0.004000 


0.001800 


0.096000 


9 


0.013300 


0.019000 


0.163800 


0.072000 


10 


0.000700 


0.076000 


0.070200 


0.288000 


11 


0.005510 


0.080000 


0.252000 


0.024000 


12 


0.000290 


0.320000 


0.106000 


0.096000 


13 


0.009215 


0.000800 


0.000070 


0.008000 


14 


0.000485 


0.003200 


0.000030 


0.032000 


15 


0.645050 


0.015200 


0.002730 


0.024000 


16 


0.033950 


0.060800 


0.001170 


0.096000 


17 


0.267235 


0.064000 


0.004200 


0.008000 


18 


0.014065 


0.256000 


0.001800 


0.032000 



Initial 


State : Z 16 








State 


C(l) 


C(2) 


C(3) 


C(4) 


1 


0.000001 


0.000010 


0.000195 


0.012000 


2 


0.000099 


0.000990 


0.003705 


0.023000 


3 


0.000070 


0.000190 


0.007605 


0.036000 


4 


0.006930 


0.018810 


0.144495 


0.084000 


5 


0.000029 


0.000800 


0.011700 


0.012000 


6 


0.002871 


0.079200 


0.222300 


0.028000 


7 


0.000002 


0.000050 


0.000300 


0.036000 


8 


0.000198 


0.004950 


0.005700 


0.084000 


9 


0.000140 


0.000950 


0.011700 


0.108000 


10 


0.013860 


0.094050 


0.222300 


0.252000 


11 


0.000058 


0.004000 


0.018000 


0.036000 


12 


0.005742 


0.396000 


0.342000 


0.084000 


13 


0.000097 


0.000040 


0.000005 


0.012000 


14 


0.009603 


0.003960 


0.000095 


0.028000 


15 


0.006790 


0.000760 


0.000195 


0.036000 


16 


0.672210 


0.075240 


0.003705 


0.084000 


17 


0.002813 


0.003200 


0.000300 


0.012000 


18 


0.278487 


0.316800 


0.005700 


0.026000 
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Initial State : Z 17 



state 


crn 


cTH 


c{T5 


C(4) 


1 


0.000095 


0.000200 


0.002730 


0.012000 


2 


0.000005 


0.000800 


0.001170 


0.048000 


3 


0.000095 


0.000200 


0.002730 


0.016000 


4 


0.000005 


0.000800 


0.001170 


0.064000 


5 


0.009310 


0.019600 


0.267540 


0.012000 


6 


0.000490 


0.078400 


0.114660 


0.048000 


7 


0.000190 


0.001000 


0.004200 


0.036000 


8 


0.000010 


0.004000 


0.001800 


0.144000 


9 


0.000190 


0.001000 


0.004200 


0.048000 


10 


0.000010 


0.004000 


0.001800 


0.192000 


11 


0.018620 


0.098000 


0.411600 


0.036000 


12 


0.000980 


0.392000 


0.176400 


0.144000 


13 


0.009215 


0.000800 


0.000070 


0.012000 


14 


0.000485 


0.003200 


0.000030 


0.048000 


15 


0.009215 


0.000800 


0.000070 


0.016000 


16 


0.000485 


0.003200 


0.000030 


0.064000 


17 


0.903070 


0.078400 


0.006860 


0.012000 


18 


0.047530 


0.313600 


0.002940 


0.048000 



Initial 


State : 2 18 








State 


cTTl 


CX2) 


cTT) 


C{4l 


1 


0.000001 


0.000010 


0.000195 


0.018000 


2 


0.000099 


0.000990 


0.003705 


0.042000 


3 


0.000001 


0.000010 


0.000195 


0.024000 


4 


0.000099 


0.000990 


0.003705 


0.056000 


5 


0.000093 


0.000930 


0.019110 


0.018000 


6 


0.009702 


0.097020 


0.363090 


0.042000 


7 


0.000002 


0.000050 


0.000300 


0.054000 


8 


0.000198 


0.004950 


0.005700 


0.126000 


9 


0.000002 


0.000050 


0.000300 


0.072000 


10 


0.000198 


0.004950 


0.005700 


0.168000 


11 


0.000196 


0.004900 


0.029400 


0.054000 


12 


0.019404 


0.485100 


0.558600 


0.126000 


13 


0.000097 


0.000040 


0.000005 


0.018000 


14 


0.009603 


0.003960 


0.000095 


0.042000 


15 


0.000097 


0.000040 


0.000005 


0.024000 


16 


0.009603 


0.003960 


0.000095 


0.056000 


17 


0.009506 


0.003920 


0.000490 


0.018000 


18 


0.941094 


0.388080 


0.009310 


0.042000 
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Goodness Measurements 



State 

Z(i) 


Combination 
vail val2 


val3 


Goodn 

value 


ess Remarks 


1 


0.00 


0.00 


0.00 


0.00 




2 


0.00 


0.00 


1.00 


1.00 




3 


0.00 


0.50 


0.00 


0.50 




4 


0.00 


0.50 


1.00 


1.50 




5 


0.00 


1.00 


0.00 


1.00 




6 


0.00 


1.00 


1.00 


2.00 


ideal 


7 


0.50 


0.00 


0.00 


-0.50 




3 


0.50 


0.00 


1.00 


0.50 




9 


0.50 


0.50 


0.00 


0.00 




10 


0.50 


0.50 


1.00 


1.00 




11 


0.50 


1.00 


0.00 


0.50 




12 


0.50 


1.00 


1.00 


1.50 




13 


1.00 


0.00 


0.00 


-1.00 


anti-ideal 


14 


1.00 


0.00 


1.00 


0.00 




15 


1.00 


0.50 


0.00 


-0.50 




15 


1.00 


0.50 


1.00 


0.50 




17 


1.00 


1.00 


0.00 


0.00 




18 


1.00 


1.00 


1.00 


1.00 





Benefit Matrix 


State 


Z(i) C(l) 


C(2) 


C(3) 




1 


0.055000 


1.235000 


0.340000 


0.300000 


2 


-0.005000 


0.425000 


-0.010000 


-0.300000 


3 


0.175000 


1.180000 


0.580000 


0.400000 


A 


0.115000 


0.370000 


0.230000 


-0.700000 


5 


0.020000 


0.770000 


0.270000 


-0.100000 


5 


-0.040000 


-0.040000 


-0.080000 


-1.200000 


7 


0.160000 


1.595000 


0.750000 


1.200000 


8 


0.100000 


0.735000 


0.400000 


0.100000 


9 


0.280000 


1.540000 


0.990000 


0.800000 


10 


0.220000 


0.730000 


0.640000 


-0.300000 


11 


0.125000 


1.130000 


0.630000 


0.300000 


12 


0.065000 


0.320000 


0.330000 


-0.300000 


13 


0.090000 


1.600000 


1.045000 


1.700000 


14 


0.030000 


0.790000 


0.695000 


0.600000 


15 


0.210000 


1.545000 


1.285000 


1.300000 


16 


0.150000 


0.735000 


0.935000 


0.200000 


17 


0.055000 


1.135000 


0.975000 


0.800000 


13 


-0.005000 


0.325000 


0.625000 


-0.300000 
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Decision Choices 



State Choice Policy 

Z(i) C(k) 



1 


2 


2 


4 


3 


2 


4 


2 


5 


4 


6 


1 


7 


2 


8 


2 


9 


2 


10 


1 


11 


2 


12 


3 


13 


4 


14 


2 


15 


2 


16 


3 


17 


2 


13 


1 



set arbitary v(18) to 0 

maxincorae per period : 2 . 220446049E-15 
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APPENDIX D 

UNIVERSITY SCHEDULE EXAMPLE 



/ -k-k:k-k:k-k:k:k:k:k:k:k^:k:k:k-k-k:k^:k^:k^:k:k:k-k9^-k:k-k'k-k 
( -k-k kk 

step I : User Interaction ** 

/ kk kk 

)kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk 



I. Formulate problem and prepare estimation probabilities 



Problem description 

P : Importance of problems to be solved 

S : Degree of effectiveness in problem-solving 

E : Potential energy of participants 

pl=0 No important problem regarding teaching load, class 
size, and thesis advising 

p2=.5 Moderate faculty shortage, large adjunct faculty, big 
class size, in*suf ficient thesis advisors, shortage of 
required infrastructural facilities 

p3=l Acute shortage of faculty, immense class size, heavy 
thesis load, and conflicts in class scheduling 

51=0 Very poor quality teaching and research faculty, poor 
administration, inability to attract new ‘faculty, 
uncontrolled student admission 

S2=.5 Moderately effective faculty, reasonable student - 
faculty ratio, nominally effective administration 

53=1 Excellent quality teaching and research faculty, best 
student - faculty ratio, effective administration and 
leadership , ample supporting infrastructural facilities 

E1=0 Faculty uninterested in teaching, insufficient time 
devoted to problem solving, low motivation 

E2=l High motivation, good productivity and commitment, 
dedicated teaching faculty, administrators 



Alternative choices 
C(l) Hire new faculty 

C(2) Administer existing faculty better 

C(3) Regulate student admission 

C(4) Tailor class size to faculty availability 

C(5) Add infrastructural facilities 
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P S E 



Choice 


0.00 


0.50 


1.00 


0.00 


0.50 


1.00 


0.00 


1.00 


1 


0.94 


0.74 


0.05 


0.10 


0.05 


0.01 


0.67 


0.08 


1 


0.05 


0.25 


0.30 


0.30 


0.35 


0.20 


0.33 


0.92 


1 


0.01 


0.01 


0.65 


0.10 


0.60 


0.79 






2 


0.97 


0.59 


0.05 


0.05 


0.20 


0.01 


0.60 


0.15 


2 


0.02 


0.40 


0.45 


0.94 


0.50 


0.10 


0.40 


0.85 


2 


0.01 


0.01 


0.50 


0.01 


0.30 


0.89 






3 


0.96 


0.60 


0.01 


0.40 


0.05 


0.01 


0.91 


0.08 


3 


0.03 


0.38 


0.40 


0.55 


0.30 


0.01 


0.09 


0.92 


3 


0.01 


0.02 


0.59 


0.05 


0.65 


0.98 






4 


0.95 


0.15 


0.01 


0.71 


0.02 


0.01 


0.89 


0.04 


4 


0.04 


0.84 


0.09 


0.26 


0.53 


0.02 


0.11 


0.96 


4 


0.01 


0.01 


0.90 


0.03 


0.45 


0.97 






5 


0.90 


0.24 


0.08 


0.84 


0.13 


0.11 


0.92 


0.30 


5 


0.05 


0.75 


0.40 


0.12 


0.57 


0.43 


0.08 


0.70 


5 


0.05 


0.01 


0.52 


0.04 


0.30 


0.46 







II. Execution 



Select Menu Option 



1. ExecGCM (Execute GCM Program 

2. ExecExit (Execution stop 



Enter # of scale points for each factor : 



factor 


1 : 


3 


factor 


2 : 


3 


factor 


3 : 


2 



goahead : Press any key, correction : "%" 



Get Number of Choices for each State Z(i) i = 1 .. 18 
State Z(i) # of choices 



1 ? 4 

2 ? 4 

3 ? 4 

4 ? 4 

5 ? 5 

6 ? 5 

7 ? 5 

S ? 5 

9 ? 5 

10 ? 5 

11 ? 5 

12 ? 5 

13 ? 4 

14 ? 4 

15 ? 4 

IS ? 4 

17 ? 5 

IS ? 5 



goahead ; Press any key, correction : "%" 
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Get Estimation Probabilities 



(factorl) 
Initial State 


11 


0.00 


Choice 


c(i) 


Terminal State 
probl prob2 


probS ? 


0.94 


0.05 0. 


01 


Initial State 


f(l) = 


0.50 


Choice 


C(l) 


Terminal State 
probl prob2 


prob3 ? 


0.74 


0.25 0. 


01 


Initial State 


f(l) = 


1.00 


Choice 


C(1) 


Terminal State 
probl prob2 


prob3 ? 


0.05 


0.30 0. 


65 





(* Display 


Input 


Data *) 




0.00 


0.50 


1.00 


1 


0.94 


0.74 


0.05 


1 


0.05 


0.25 


0.30 


1 


0.01 


0.01 


0.65 


oahead 


: Press any key, correction : 



Repeat this step for remaining (n-l)factors 
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:k:k :ki^\ 

Step II : Generate Matrices '^'^) 

•k-k kk\ 

kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk\ 







Transition Matrix 


Initial State 


: Z 1 





State 


C(1) 


C(2) 


CTT5 


C(4) 


1 


0.062980 


0.029100 


0.349440 


0.600305 


2 


0.031020 


0.019400 


0.034560 


0.074195 


3 


0.503840 


0.547030 


0.480480 


0.219330 


4 


0.248160 


0.364720 


0.047520 


0.027170 


5 


0.062980 


0.005320 


0.043680 


0.025365 


6 


0.031020 


0.003830 


0.004320 


0.003135 


7 


0.003350 


0.000600 


0.010920 


0.025276 


8 


0.001650 


0.000400 


0.001080 


0.003124 


9 


0.026800 


0.011280 


0.015015 


0.009256 


10 


0.013200 


0.007520 


0.001485 


0.001144 


11 


0.003350 


0.000120 


0.001365 


0.001068 


12 


0.001650 


0.000080 


0.000135 


0.000132 


13 


0.000670 


0.000300 


0.003640 


0.006319 


14 


0.00C330 


0.000200 


0.000360 


0.000781 


15 


0.005360 


0.005640 


0.005005 


0.002314 


16 


0.002640 


0.003760 


0.000495 


0.000286 


17 


0.000670 


0.000060 


0.000455 


0.000267 


18 


0.000330 


0.000040 


0.000045 


0.000033 



Initial 


state : Z 2 








state 


C(l) 


Cl2l 


CTT) 


Cl4l 


1 


0.007520 


0.007275 


0.030720 


0.026980 


2 


0.036430 


0.041225 


0.353280 


0.647520 


3 


0.060160 


0.136770 


0.042240 


0.009880 


4 


0.691340 


0.775030 


0.485760 


0.237120 


5 


0.007520 


0.001455 


0.003840 


0.001140 


6 


0.086480 


0.008245 


0.044160 


0.027360 


7 


0.000400 


0.000150 


0.000960 


0.001136 


8 


0.004600 


0.000850 


0.011040 


0.027264 


9 


0.003200 


0.002820 


0.001320 


0.000416 


10 


0.036800 


0.015980 


0.015130 


0.009984 


11 


0.000400 


0.000030 


0.000120 


0.000043 


12 


0.004600 


0.000170 


0.001380 


0.001152 


13 


0.000080 


0.000075 


0.000320 


0.000234 


14 


0.000920 


0.000425 


O.OC3680 


0.006816 


15 


0.000640 


0.001410 


0.000440 


0.000104 


16 


0.007360 


0.007990 


0.005060 


0.002496 


17 


0.000080 


0.000015 


0.000040 


0.000012 


18 


0.000920 


0.000085 


0.000460 


0.000288 
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Initial State : Z 3 



state 


C(l) 


CT2] 


C(3) 


C(4) 


1 


0.031490 


0.116400 


0.043680 


0.016910 


2 


0.015510 


0.077600 


0.004320 


0.002090 


3 


0.220430 


0.291000 


0.262080 


0.448115 


4 


0.103570 


0.194000 


0.025920 


0.055385 


5 


0.377880 


0.174600 


0.567840 


0.380475 


6 


0.186120 


0.116400 


0.056160 


0.047025 


7 


0.001675 


0.002400 


0.001365 


0.000712 


8 


0.000825 


0.001600 


0.000135 


0.000088 


9 


0.011725 


0.006000 


0.008190 


0.018868 


10 


0.005775 


0.004000 


0.000810 


0.002332 


11 


0.020100 


0.003600 


0.017745 


0.016020 


12 


0.009900 


0.002400 


0.001755 


0.001980 


13 


0.000335 


0.001200 


0.000455 


0.000178 


14 


0.000165 


0.000800 


0.000045 


0.000022 


15 


0.002345 


0.003000 


0.002730 


0.004717 


16 


0.001155 


0.002000 


0.000270 


0.000533 


17 


0.004020 


0.001800 


0.005915 


0.004005 


18 


0.001980 


0.001200 


0.000585 


0.000495 



Initial 


State : Z 4 








State 


cm 


cm 


cm 


cm 


1 


0.003760 


0.029100 


0.003840 


0.000760 


2 


0.043240 


0.164900 


0.044160 


0.018240 


3 


0.026320 


0.072750 


0.023040 


0.020140 


4 


0.302680 


0.412250 


0.264960 


0.483360 


5 


0.045120 


0.043650 


0.049920 


0.017100 


6 


0.518880 


0.247350 


0.574080 


0.410400 


7 


0.000200 


0.000600 


0.000120 


0.000032 


8 


0.002300 


0.003400 


0.001380 


0.000768 


9 


0.001400 


0.001500 


0.000720 


0.000848 


10 


0.016100 


0.008500 


0.008280 


0.020352 


11 


0.002400 


0.000900 


0.001560 


0.000720 


12 


0.027600 


0.005100 


0.017940 


0.017280 


13 


0.000040 


0.000300 


0.000040 


0.000008 


14 


0.000460 


0.001700 


0.000460 


0.000192 


15 


0.000280 


0.000750 


0.000240 


0.000212 


16 


0.003220 


0.004250 


0.002760 


0.005088 


17 


0.000480 


0.000450 


0.000520 


0.000180 


18 


0.005520 


0.002550 


0.005980 


0.004320 
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Initial State : Z 5 



Stare 


— m) 


C(2) 


C(3) 


CT4) 


cTIl 


1 


0.006298 


0.005820 


0.008736 


0.008455 


0.091080 


2 


0.003102 


0.003880 


0.000864 


0.001045 


0.007920 


3 


0.125960 


0.058200 


0.008736 


0.016910 


0.356040 


4 


0.062040 


0.038300 


0.000864 


0.002090 


0.030960 


5 


0.497542 


0.517980 


0.856128 


0.820135 


0.380880 


6 


0.245053 


0.345320 


0.084672 


0.101365 


0.033120 


7 


0.000335 


0.000120 


0.000273 


0.000356 


0.005060 


3 


0.000165 


0.000080 


0.000027 


0.000044 


0.000440 


0 


0.006700 


0.001200 


0.000273 


0.000712 


0.019780 


id 


0.003300 


0.000800 


0.000027 


0.000088 


0.001720 


11 


0.026465 


0.010680 


0.026754 


0.034532 


0.021160 


12 


0.013035 


0.007120 


0.002646 


0.004268 


0.001840 


13 


0.000067 


0.000060 


0.000091 


0.000039 


0.005060 


14 


0.000033 


0.000040 


0.000009 


0.000011 


0.000440 


15 


0.001340 


0.000600 


0.000091 


0.000178 


0.019780 


16 


0.000660 


0.000400 


0.000009 


0.000022 


0.001720 


17 


0.005293 


0.005340 


0.008918 


0.008633 


0.021160 


18 


0.002607 


0.003560 


0.000882 


0.001067 


0.001840 



Initial 


State : Z 6 










state 


cirj 


cID 


cTTJ 




cTFJ 


1 


0.000752 


0.001455 


0.000768 


0.000380 


0.029700 


2 


0.003648 


0.008245 


0.008832 


0.009120 


0.069300 


3 


0.015040 


0.014550 


0.000768 


0.000760 


0.116100 


4 


0.172960 


0.082450 


0.008332 


0.018240 


0.270900 


5 


0.059408 


0.129495 


0.075264 


0.036860 


0.124200 


6 


0.683192 


0.733805 


0.865536 


0.884640 


0.289800 


7 


0.000040 


0.000030 


0.000024 


0.000016 


0.001650 


8 


0.000460 


0.000170 


0.000276 


0.000384 


0.003850 


9 


0.000800 


0.000300 


0.000024 


0.000032 


0.006450 


10 


0.009200 


0.001700 


0.000276 


0.000768 


0.015050 


11 


0.003160 


0.002670 


0.002352 


0.001552 


0.006900 


12 


0.036340 


0.015130 


0.027048 


0.037243 


0.016100 


13 


0.000008 


0.000015 


0.000008 


0.000004 


0.001650 


14 


0.000092 


0.000085 


0.000092 


0.000096 


0.003850 


15 


0.000160 


0.000150 


0.000008 


0.000008 


0.006450 


16 


0.001840 


0.000850 


0.000092 


0.000192 


0.015050 


17 


0.000632 


0.001335 


0.000784 


0.000388 


0.006900 


13 


0.007268 


0.007565 


0.009016 


0.009312 


0.016100 
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Initial State : Z 7 



state 


cTD 


m) 


CT31 


CITJ 




1 


0.049580 


0.017700 


0.218400 


0.094785 


0.135472 


2 


0.024420 


0.011800 


0.021600 


0.011715 


0.016128 


3 


0.396640 


0.332760 


0.300300 


0.034710 


0.026496 


4 


0.195360 


0.221840 


0.029700 


0.004290 


0.002304 


5 


0.049580 


0.003540 


0.027300 


0.004005 


0.008332 


6 


0.024420 


0.002360 


0.002700 


0.000495 


0.000768 


7 


0.016750 


0.012000 


0.138320 


0.530796 


0.579600 


8 


0.003250 


0.008000 


0.013630 


0.065604 


0.050400 


9 


0.134000 


0.225600 


0.190190 


0.194376 


0.082800 


10 


0.066000 


0.150400 


0.018810 


0.024024 


0.007200 


11 


0.016750 


0.002400 


0.017290 


0.022428 


0.027600 


12 


0.003250 


0.001600 


0.001710 


0.002772 


0.002400 


13 


0.000670 


0.000300 


0.007280 


0.006319 


0.007728 


14 


0.000330 


0.000200 


0.000720 


0.000781 


0.000672 


15 


0.005360 


0.005640 


0.010010 


0.002314 


0.001104 


16 


0.002640 


0.003760 


0.000990 


0.000286 


0.000096 


17 


0.000670 


0.000060 


0.000910 


0.000267 


0.000368 


18 


0.000330 


0.000040 


0.000090 


0.000033 


0.000032 



Initial 


State : Z 8 










state 


cm 


cm 


cXTJ 


C(4) 


C(5) 


1 


0.005920 


0.004425 


0.019200 


0.004260 


0.060480 


2 


0.068080 


0.025075 


0.220800 


0.102240 


0.141120 


3 


0.047360 


0.083190 


0.026400 


0.001560 


0.008640 


4 


0.544640 


0.471410 


0.303600 


0,037440 


0.020160 


c 


0.005920 


0.000885 


0.002400 


0.000180 


0.002880 


6 


0.068080 


0.005015 


0.027600 


0.004320 


0.006720 


7 


0.002000 


0.003000 


0.012160 


0,023856 


0.139000 


8 


0.023000 


0.017000 


0.139840 


0.572544 


0.441000 


9 


0.016000 


0.056400 


0.016720 


0.008736 


0.027000 


10 


0.184000 


0.319600 


0.192280 


0.209664 


0.063000 


11 


0.002000 


0.000600 


0.001520 


0.001003 


0.009000 


12 


0.023000 


0.003400 


0.017480 


0.024192 


0.021000 


13 


0.000080 


0.000075 


0.000640 


0.00C284 


0.002520 


14 


0.000920 


0.000425 


0.007360 


0.006816 


0.005880 


15 


0.000640 


0.001410 


0.000880 


0.000104 


0,000360 


16 


0.007360 


0.007990 


0.010120 


0.002496 


0.000840 


17 


0.000030 


0.000015 


0.000080 


0.000012 


0.000120 


13 


0.000920 


0.000085 


0.000920 


0.000288 


0.000280 



81 



Initial State : Z 9 



state 


cTT5 


Cl2l 


cIT5 


cTTJ 


cTIl 


1 


0.024790 


0.070800 


0.027300 


0.002670 


0.028704 


2 


0.012210 


0.047200 


0.002700 


0.000330 


0.002496 


3 


0.173530 


0.177000 


0.163800 


0.070755 


0.125856 


L 


0.085470 


0.118000 


0.016200 


0.008745 


0.010944 


5 


0.297480 


0.106200 


0.354900 


0.060075 


0.066240 


6 


0.146520 


0.070800 


0.035100 


0.007425 


0.005760 


7 


0.008375 


0.048000 


0.017290 


0.014952 


0.089700 


8 


0.004125 


0.032000 


0.001710 


0.001848 


0.007800 


9 


0.058625 


0.120000 


0.103740 


0.396228 


0.393300 


10 


0.028875 


O.OSOOOO 


0.010260 


0.048972 


0.034200 


11 


0.100500 


0.072000 


0.224770 


0.336420 


0.207000 


12 


0.049500 


0.048000 


0.022230 


0.041580 


0.018000 


13 


0.000335 


0.001200 


0.000910 


0.000178 


0.001196 


14 


0.000165 


0.000800 


0.000090 


0.000022 


0.000104 


15 


0.002345 


0.003000 


0.005460 


0.004717 


0.005244 


16 


0.001155 


0.002000 


0.000540 


0.0005S3 


0.000456 


17 


0.004020 


0.001800 


0.011830 


0.004005 


0.002760 


18 


0.001980 


0.001200 


0.001170 


0.000495 


0.000240 



Initial 


state : Z 10 










State 


cIT) 


cXH 


cIT5 


Cl4) 


cXTJ 


1 


0.002960 


0.017700 


0.002400 


0.003350 


0.001500 


2 


0.034040 


0.100300 


0.027600 


0.001650 


0.001000 


3 


0.020720 


0.044250 


0.014400 


0.026800 


0.023200 


4 


0.233280 


0.250750 


0.165600 


0.013200 


0.018800 


5 


0.035520 


0.026550 


0.031200 


0.003350 


0.000300 


6 


0.408480 


0.150450 


0.358800 


0.001650 


0.000200 


7 


O.OOIOCO 


0.012000 


0.001520 


0.020100 


0.013500 


8 


0.011500 


0.068000 


0.017480 


0.009900 


0.009000 


9 


0.007000 


0.030000 


0.009120 


0.160800 


0.253800 


10 


0.080500 


0.170000 


0.104880 


0.079200 


0.169200 


11 


0.0120C0 


0.018000 


0.019760 


0.020100 


0.002700 


12 


0.138000 


0.102000 


0.227240 


0.009900 


0.001800 


13 


0.000040 


0.000300 


0.000030 


0.043550 


0.015000 


14 


0.000460 


0.001700 


0.000920 


0.021450 


0.010000 


15 


0.000280 


0.000750 


0.000480 


0.348400 


0.282000 


16 


0.003220 


0.004250 


0.005520 


0.171600 


0.188000 


17 


0.000430 


0.000450 


0.001040 


0.043550 


0.003000 


18 


0.005520 


0.002550 


0.011960 


0.021450 


0.002000 
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Initial State : Z 11 



state 


cm 


cm 


C(3) 


C(4) 


cm 


1 


0.003640 


0.006319 


0.000400 


0.00037^ 


0.000320 


2 


0.000360 


0.000781 


0.004600 


0.002125 


0.003630 


3 


0.005005 


0.002314 


0.003200 


0.007050 


0.000440 


4 


0.000495 


0.000236 


0.036800 


0.039950 


0.005060 


5 


0.000455 


0.000267 


0.000400 


0.000075 


0.000040 


6 


0.000045 


0.000033 


0.004600 


0.000425 


0.000460 


7 


0.145600 


0.056871 


0.002400 


0.003375 


0.012800 


8 


0.014400 


0.007029 


0.027600 


0.019125 


0.147200 


9 


0.200200 


0.020826 


0.019200 


0.063450 


0.017600 


10 


0.019800 


0.002574 


0.220800 


0.359550 


0.202400 


11 


0.018200 


0.002403 


0.002400 


0.000675 


0.001600 


12 


0.001800 


0.000297 


0.027600 


0.003825 


0.018400 


13 


0.214760 


0.568710 


0.005200 


0.003750 


0.018880 


14 


0.021240 


0.070290 


0.059800 


0.021250 


0.217120 


15 


0.295295 


0.208260 


0.041600 


0.070500 


0.025960 


16 


0.029205 


0.025740 


0.478400 


0.399500 


0.298540 


17 


0.026845 


0.024030 


0.005200 


0.000750 


0.002360 


18 


0.002655 


0.002970 


0.059800 


0.004250 


0.027140 



Initial 


State : Z 12 










state 


cm 


cm 


cm 


cm 


cm 


1 


0.000284 


0.001675 


0.006000 


0.000455 


0.000178 


2 


0.006816 


0.000825 


0.004000 


0.000045 


0.000022 


3 


0.000104 


0.011725 


0.015000 


0.002730 


0.004717 


4 


0.002496 


0.005775 


0.010000 


0.000270 


0.000583 


5 


0.000012 


0.020100 


0.009000 


0.005915 


0.004005 


6 


0.000288 


0.009900 


0.006000 


0 . 000585 


0.000495 


7 


0.002556 


0.010050 


0.054000 


0.018200 


0.001602 


8 


0.061344 


0.004950 


0.036000 


0.001800 


0.000198 


9 


0.000936 


0.070350 


0.135000 


0.109200 


0.042453 


10 


0.022464 


0.034650 


0.090000 


0.010800 


0.005247 


11 


0.000108 


0.120600 


0.081000 


0.236600 


0.036045 


12 


0.002592 


0.059400 


0.054000 


0.023400 


0.004455 


13 


0.025560 


0.021775 


0.060000 


0.026845 


0.016020 


14 


0.613440 


0.010725 


0.040000 


0.002655 


0.001980 


15 


0.009360 


0.152425 


0.150000 


0.161070 


0.424530 


16 


0.224640 


0.075075 


0.100000 


0.015930 


0.052470 


17 


0.001080 


0.261300 


0.090000 


0.348985 


0.360450 


18 


0.025920 


0.128700 


0.060000 


0.034515 


0.044550 



83 



Initial State : Z 13 



State 


C(l) 


C(2) 


cTD 


cITJ 


1 


0.003350 


oTooTSoo 


0.003640 


0.006319 


2 


0.001650 


0.001000 


0.000360 


0.000781 




0.026800 


0.028200 


0.005005 


0.002314 


4 


0.013200 


0.018800 


0.000495 


0.000286 


5 


0,003350 


0.000300 


0.000455 


0.000267 


6 


0.001650 


0.000200 


0.000045 


0.000033 


7 


0.020100 


0.013500 


0.145600 


0.056871 


3 


0.009900 


0.009000 


0.014400 


0.007029 


9 


0.160800 


0.253800 


0.200200 


0.020826 


10 


0.079200 


0.169200 


0.019800 


0.002574 


11 


0.020100 


0.002700 


0.018200 


0.002403 


12 


0.009900 


0.001800 


0.001800 


0.000297 


13 


0.043550 


0.015000 


0.214760 


0.568710 


14 


0.021450 


0.010000 


0.021240 


0.070290 


15 


0.348400 


0.282000 


0.295295 


0.208260 


16 


0.171600 


0.188000 


0.029205 


0.025740 


17 


0.043550 


0.003000 


0.026845 


0.024030 


13 


0.021450 


0.002000 


0.002655 


0.002970 



Initial 


State : Z 14 








state 


cm 


cm 


cm 


C(4) 


1 


0.000400 


0.000375 


0.000320 


0.000284 


2 


0.004600 


0.002125 


0.003680 


0.006816 


3 


0.003200 


0.007050 


0.000440 


0.000104 


4 


0 . 036800 


0.039950 


0.005060 


0.002496 


5 


0.000400 


0.000075 


0.000040 


0.000012 


6 


0.004600 


0.000425 


0.000460 


0.000288 


7 


0.002400 


0.003375 


0.012800 


0.002556 


8 


0.027600 


0.019125 


0.147200 


0.061344 


9 


0.019200 


0.063450 


0.017600 


0.000936 


10 


0.220800 


0.359550 


0.202400 


0.022464 


11 


0.002400 


0.000675 


0.001600 


0.000108 


12 


0.027600 


0.003825 


0.018400 


0.002592 


13 


0.005200 


0.003750 


0.013880 


0.025560 


14 


0.059800 


0.021250 


0.217120 


0.613440 


15 


0.041600 


0.070500 


0.025960 


0.009360 


16 


0.478400 


0.399500 


0.293540 


0.224640 


17 


0.005200 


0.000750 


0.002360 


0.001080 


13 


0.059800 


0.004250 


0.027140 


0.025920 



84 



Initial State ; Z 15 



state 


— cm 


cm 


C(3) 


C(4) 


1 


0.001675 


0.006000 


0.000455 


0.000178 


2 


0.000825 


0.004000 


0.000045 


0.000022 


3 


0.011725 


0.015000 


0.002730 


0.004717 


4 


0.005775 


0.010000 


0.000270 


0.000583 


5 


0.020100 


0.009000 


0.005915 


0.004005 


6 


0.009900 


0.006000 


0.000585 


0.000495 


7 


0.010050 


0.054000 


0.018200 


0.001602 


8 


0.004950 


0.036000 


0.001800 


0.000198 


9 


0.070350 


0.135000 


0.109200 


0.042453 


10 


0.034650 


0.090000 


0.010800 


0.005247 


11 


0.120600 


0.081000 


0.236600 


0.036045 


12 


0.059400 


0.054000 


0.023400 


0.004455 


13 


0.021775 


0.060000 


0.026845 


0.016020 


14 


0.010725 


0.040000 


0.002655 


0.001980 


15 


0.152425 


0.150000 


0.161070 


0.424530 


16 


0.075075 


0.100000 


0.015930 


0.052470 


17 


0.261300 


0.090000 


0.348985 


0.360450 


18 


0.128700 


0.060000 


0.034515 


0.044550 



Initial 


State : Z 16 








state 


C(l) 


C(2) 


C(3) 


C(4) 


1 


0.000200 


0.001500 


0.000040 


0.000008 


2 


0.002300 


0.008500 


0.000460 


0.000192 


3 


0.001400 


0.003750 


0.000240 


0.000212 


4 


0.016100 


0.021250 


0.002760 


0.005083 


5 


0.002400 


0.002250 


0.000520 


0.000180 


6 


0.027600 


0.012750 


0.005980 


0.004320 


7 


0.001200 


0.013500 


0.001600 


0.000072 


8 


0.013800 


0.076500 


0.018400 


0.001728 


9 


0.008400 


0.033750 


0.009600 


0.001908 


10 


0.096600 


0.191250 


0.110400 


0.045792 


11 


0.014400 


0.020250 


0.020800 


0.001620 


12 


0.165600 


0.114750 


0.239200 


0.038880 


13 


0.002600 


0.015000 


0.002360 


0.000720 


14 


0.029900 


0.035000 


0.027140 


0.017280 


15 


0.018200 


0.037500 


0.014160 


0.019080 


16 


0.209300 


0.212500 


0.162840 


0.457920 


17 


0.031200 


0.022500 


0.030680 


0.016200 


13 


0.358800 


0.127500 


0.352820 


0.388300 



85 



nitial State : Z 17 






state 


C(1) 


Cl2) 


C(3) 


cT4) 


cTTJ 


1 


6.000335 


0.000300 


0.000091 


0.000089 


0.008096 


2 


0.000165 


0.000200 


0.000009 


0.000011 


0.000704 


3 


0.006700 


0.003000 


0.000091 


0.000178 


0.031648 


4 


0.003300 


0.002000 


0.000009 


0.000022 


0.002752 


5 


0.026465 


0.026700 


0.008913 


0.008633 


0.033856 


6 


0.013035 


0.017800 


0.000882 


0.001067 


0.002944 


7 


0.002010 


0.002700 


0.003640 


0.000801 


0.040430 


8 


0.000990 


0.001800 


0.000360 


0.000099 


0.003520 


9 


0.C40200 


0.027000 


0.003640 


0.001602 


0.158240 ^ 


10 


0.019800 


0.018000 


0.000360 


0.000198 


0.013760 . 


11 


0.153790 


0.240300 


0.356720 


0.077697 


0.169280 


12 


0.078210 


0.160200 


0.035280 


0.009603 


0.014720 


13 


0.004355 


0.003000 


0.005369 


0.008010 


0.052624 


14 


0.002145 


0.002000 


0.000531 


0.000990 


0.004576 


15 


0.037100 


0.030000 


0.005369 


0.016020 


0.205712 


16 


0.042900 


0.020000 


0.000531 


0.001980 


0.017888 


17 


0.344045 


0.267000 


0.526162 


0.776970 


0.220064 


IS 


0.169455 


0.173000 


0.052038 


0.096030 


0.019136 



Initial 


state : Z 18 










state 


CTTJ 


cT2l 


c(T5 


CT4} 


cm 


1 


0.000040 


0.000075 


0.000008 


0.000004 


0.002640 


2 


0.000460 


0.000425 


0.000092 


0.000096 


0.006160 


3 


0.000800 


0.000750 


0.000008 


0.000008 


0.010320 


4 


0.009200 


0.004250 


0.000092 


0.000192 


0.024080 


5 


0.003160 


0.006675 


0.000784 


0.000388 


0.011040 


6 


0.036340 


0.037325 


0.009016 


0.009312 


0.025760 


7 


0.000240 


0.000675 


0.000320 


0.000036 


0.013200 


8 


0.002760 


0.003825 


0.003680 


0.000864 


0.030800 


9 


0.004800 


0.006750 


0.000320 


0.000072 


0.051600 


10 


0.055200 


0.038250 


0.003680 


0.001728 


0.120400 


11 


0.018960 


0.060075 


0.031360 


0.003492 


0.055200 


12 


0.218040 


0.340425 


0.360640 


0.083808 


0.128300 


13 


0.000520 


0.000750 


0.000472 


0.000360 


0.017160 


14 


0.005980 


0.004250 


0.005428 


0.008640 


0.040040 


15 


0.0104CO 


0.007500 


0.000472 


0.000720 


0.067080 


16 


0.119600 


0.042500 


0.005428 


0.017230 


0.156520 


17 


0.041080 


0.066750 


0.046256 


0.034920 


0.071760 


13 


0.472420 


0.378250 


0.531944 


0.838080 


0.167440 



86 



Goodness Measurements 



State Combination Goodness Remarks 

Z(i) vail val2 val3 value 



1 


0.00 


0.00 


2 


0.00 


0.00 




0,00 


0.50 


4 


0.00 


0.50 


5 


0.00 


1,00 


6 


0.00 


1.00 


7 


0.50 


0.00 


3 


0.50 


0.00 


9 


0.50 


0.50 


10 


0.50 


0.50 


11 


0.50 


1.00 


12 


0.50 


1.00 


13 


1.00 


0.00 


14 


1.00 


0.00 


15 


1.00 


0.50 


16 


1.00 


0.50 


17 


1.00 


1.00 


18 


1.00 


1.00 



1.00 1.00 

0.00 0.50 

1.00 1.50 

0.00 1.00 

1.00 2.00 ideal 

0.00 -0.50 

1.00 0.50 

0.00 0.00 

1.00 1.00 

0.00 0.50 

1.00 1.50 

0.00 -1.00 anti-ideal 

1.00 0.00 

0,00 -0.50 

1.00 0.50 

0.00 0.00 

1.00 1,00 



Benefit Matrix 



State 


Z(i) C(l) 


C{2) 


C(3) 


C(4) 


C(5) 


1 


0.795000 


0.860000 


0.390000 


0.240000 




2 


0.385000 


0.310000 


0.220000 


0.090000 




3 


0,570000 


0,430000 


0.365000 


0.295000 




4 


0.160000 


-0.120C00 


0.195000 


0.145000 




5 


0,185000 


0.320000 


0.050000 


0.060000 


-0.320000 


6 


-0.225000 


-0.230000 


-0.120000 


-0.090000 


-0.700000 


7 


1.195000 


1.170000 


0.705000 


0.340000 


0,295000 


8 


0.785000 


0.620000 


0.535000 


0.190000 


-0.085000 


9 


0.970000 


0.740000 


0.680000 


0.395000 


0.280000 


10 


0.560000 


0.190000 


0.510000 


-0.970000 


-0.845000 


11 


-0.875000 


-1.175000 


0,120000 


0.105000 


-0.045000 


12 


-1.325000 


-1.195000 


-1.275000 


-1.400000 


-1.620000 


13 


1.030000 


1.155000 


0.625000 


0,325000 




14 


0.620000 


0.605000 


0.455000 


0.175000 




15 


0.805000 


0.725000 


0.600000 


0.380000 




16 


0.395000 


0.175000 


0.430000 


0,230000 




17 


0.420000 


0.615000 


0,285000 


0.145000 


0.035000 


18 


0.010000 


0.065000 


0.115000 


-0.005000 


-0.345000 
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Decision Choices 



State Choice Policy 

Z(i) c(k) 



1 


1 


2 


1 


3 


1 


4 


3 


5 


1 


6 


4 


7 


1 


8 


1 


9 


1 


10 


4 


11 


4 


12 


2 


13 


1 


14 


2 


15 


1 


16 


3 


17 


1 


16 


4 



set arbitary v(13) to 0 

maxincome per period : 5 .412337245E-16 
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